L0 regularization for sparse weights¶
L0 regularization is a powerful technique that creates sparse weights during calibration, effectively reducing the dataset size by setting many weights to zero. This is particularly useful when:
You need to reduce computational costs in downstream processing
You want to identify the most important records in your dataset
You need a smaller, representative sample that still matches population targets
How L0 regularization works¶
L0 regularization adds a penalty term to the calibration loss that encourages weights to be exactly zero. Unlike L1 regularization (which shrinks weights), L0 creates truly sparse solutions by using a differentiable approximation of the L0 norm through the Hard Concrete distribution.
from microcalibrate import Calibration
import numpy as np
import pandas as pd
import logging
calibration_logger = logging.getLogger("microcalibrate.calibration")
calibration_logger.setLevel(logging.WARNING)
np.random.seed(42)
Example 1: Basic L0 regularization¶
Let’s create a synthetic dataset and apply L0 regularization to reduce its size while maintaining calibration accuracy.
# Create synthetic data
n_samples = 5000
n_targets = 10
# Generate random data with some structure
age_groups = np.random.choice(['18-30', '31-50', '51-65', '65+'], n_samples)
income = np.random.lognormal(10.5, 0.8, n_samples) # Log-normal income distribution
employed = np.random.binomial(1, 0.65, n_samples)
# Create estimate matrix with various demographic combinations
estimate_matrix = pd.DataFrame()
for age in ['18-30', '31-50', '51-65', '65+']:
mask = age_groups == age
estimate_matrix[f'income_{age}'] = mask * income
estimate_matrix[f'employed_{age}'] = mask * employed
estimate_matrix['total_income'] = income
estimate_matrix['total_employed'] = employed
# Set realistic targets (scaled population values)
targets = estimate_matrix.sum().values * 1.1 # 10% higher than unweighted
print(f"Dataset size: {n_samples} records")
print(f"Number of targets: {len(targets)}")
print(f"Target names: {list(estimate_matrix.columns)}")
Dataset size: 5000 records
Number of targets: 10
Target names: ['income_18-30', 'employed_18-30', 'income_31-50', 'employed_31-50', 'income_51-65', 'employed_51-65', 'income_65+', 'employed_65+', 'total_income', 'total_employed']
Comparing standard vs L0 calibration¶
# Standard calibration (no sparsity)
weights_init = np.ones(n_samples)
cal_standard = Calibration(
weights=weights_init.copy(),
targets=targets,
estimate_matrix=estimate_matrix,
epochs=200,
learning_rate=1e-3,
regularize_with_l0=False
)
print("Running standard calibration...")
perf_standard = cal_standard.calibrate()
weights_standard = cal_standard.weights
print(f"\nStandard calibration results:")
print(f"Non-zero weights: {np.sum(weights_standard != 0)} ({100*np.mean(weights_standard != 0):.1f}%)")
print(f"Weight range: [{weights_standard.min():.3f}, {weights_standard.max():.3f}]")
Running standard calibration...
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=20.4, weights_mean=6.08, weights_std=2.88, weights_min=1]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.9, weights_mean=6.02, weights_std=2.85, weights_min=0.993]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.5, weights_mean=5.96, weights_std=2.82, weights_min=0.983]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19, weights_mean=5.9, weights_std=2.79, weights_min=0.973]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.5, weights_mean=5.84, weights_std=2.77, weights_min=0.964]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.1, weights_mean=5.79, weights_std=2.74, weights_min=0.954]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.7, weights_mean=5.73, weights_std=2.71, weights_min=0.945]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.3, weights_mean=5.68, weights_std=2.69, weights_min=0.936]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.9, weights_mean=5.62, weights_std=2.66, weights_min=0.927]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.5, weights_mean=5.57, weights_std=2.64, weights_min=0.919]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.1, weights_mean=5.52, weights_std=2.61, weights_min=0.91]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.8, weights_mean=5.47, weights_std=2.59, weights_min=0.902]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.4, weights_mean=5.42, weights_std=2.57, weights_min=0.894]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.1, weights_mean=5.37, weights_std=2.54, weights_min=0.886]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.7, weights_mean=5.33, weights_std=2.52, weights_min=0.878]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.4, weights_mean=5.28, weights_std=2.5, weights_min=0.871]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.1, weights_mean=5.23, weights_std=2.48, weights_min=0.863]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=13.8, weights_mean=5.19, weights_std=2.46, weights_min=0.856]
Reweighting progress: 86%|████████▌ | 171/200 [00:00<00:00, 1704.76epoch/s, loss=13.8, weights_mean=5.19, weights_std=2.46, weights_min=0.856]
Reweighting progress: 86%|████████▌ | 171/200 [00:00<00:00, 1704.76epoch/s, loss=13.5, weights_mean=5.15, weights_std=2.44, weights_min=0.849]
Reweighting progress: 86%|████████▌ | 171/200 [00:00<00:00, 1704.76epoch/s, loss=13.2, weights_mean=5.1, weights_std=2.42, weights_min=0.842]
Reweighting progress: 100%|██████████| 200/200 [00:00<00:00, 1713.33epoch/s, loss=13.2, weights_mean=5.1, weights_std=2.42, weights_min=0.842]
Standard calibration results:
Non-zero weights: 5000 (100.0%)
Weight range: [0.835, 9.164]
# L0 regularized calibration
cal_l0 = Calibration(
weights=weights_init.copy(),
targets=targets,
estimate_matrix=estimate_matrix,
epochs=200,
learning_rate=1e-3,
regularize_with_l0=True,
l0_lambda=5e-6, # Regularization strength
init_mean=0.999, # Start with most weights active
temperature=0.5, # Controls sparsity gradient
)
print("Running L0 regularized calibration...")
perf_l0 = cal_l0.calibrate()
weights_l0 = cal_l0.sparse_weights
print(f"\nL0 calibration results:")
print(f"Non-zero weights: {np.sum(weights_l0 != 0)} ({100*np.mean(weights_l0 != 0):.1f}%)")
print(f"Dataset reduction: {100*(1 - np.mean(weights_l0 != 0)):.1f}%")
print(f"Weight range: [{weights_l0[weights_l0>0].min():.3f}, {weights_l0.max():.3f}]")
Running L0 regularized calibration...
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=20.8, weights_mean=6.11, weights_std=2.9, weights_min=1]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=20.3, weights_mean=6.04, weights_std=2.87, weights_min=0.991]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.8, weights_mean=5.98, weights_std=2.84, weights_min=0.981]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.4, weights_mean=5.93, weights_std=2.81, weights_min=0.971]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.9, weights_mean=5.87, weights_std=2.79, weights_min=0.962]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.5, weights_mean=5.81, weights_std=2.76, weights_min=0.952]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18, weights_mean=5.76, weights_std=2.73, weights_min=0.943]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.6, weights_mean=5.7, weights_std=2.71, weights_min=0.934]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.2, weights_mean=5.65, weights_std=2.68, weights_min=0.926]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.8, weights_mean=5.6, weights_std=2.66, weights_min=0.917]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.4, weights_mean=5.54, weights_std=2.63, weights_min=0.909]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.1, weights_mean=5.49, weights_std=2.61, weights_min=0.9]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.7, weights_mean=5.45, weights_std=2.58, weights_min=0.892]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.4, weights_mean=5.4, weights_std=2.56, weights_min=0.884]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15, weights_mean=5.35, weights_std=2.54, weights_min=0.877]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.7, weights_mean=5.3, weights_std=2.52, weights_min=0.869]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.4, weights_mean=5.26, weights_std=2.5, weights_min=0.861]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.1, weights_mean=5.21, weights_std=2.47, weights_min=0.854]
Reweighting progress: 86%|████████▌ | 172/200 [00:00<00:00, 1717.45epoch/s, loss=14.1, weights_mean=5.21, weights_std=2.47, weights_min=0.854]
Reweighting progress: 86%|████████▌ | 172/200 [00:00<00:00, 1717.45epoch/s, loss=13.8, weights_mean=5.17, weights_std=2.45, weights_min=0.847]
Reweighting progress: 86%|████████▌ | 172/200 [00:00<00:00, 1717.45epoch/s, loss=13.5, weights_mean=5.13, weights_std=2.43, weights_min=0.84]
Reweighting progress: 100%|██████████| 200/200 [00:00<00:00, 1728.64epoch/s, loss=13.5, weights_mean=5.13, weights_std=2.43, weights_min=0.84]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0332, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.037, loss_rel_change=0.116]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0282, loss_rel_change=-0.149]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0257, loss_rel_change=-0.225]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0303, loss_rel_change=-0.0876]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0297, loss_rel_change=-0.104]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0259, loss_rel_change=-0.219]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0254, loss_rel_change=-0.236]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0279, loss_rel_change=-0.161]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.028, loss_rel_change=-0.157]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0258, loss_rel_change=-0.223]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0264, loss_rel_change=-0.204]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0271, loss_rel_change=-0.184]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0262, loss_rel_change=-0.211]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0253, loss_rel_change=-0.237]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0262, loss_rel_change=-0.209]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0261, loss_rel_change=-0.213]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0256, loss_rel_change=-0.23]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0258, loss_rel_change=-0.221]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0254, loss_rel_change=-0.234]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.247]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0255, loss_rel_change=-0.232]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0253, loss_rel_change=-0.238]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.245]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.239]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.245]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.247]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.24]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.242]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.245]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.249]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.25]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.25]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.251]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0248, loss_rel_change=-0.254]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0249, loss_rel_change=-0.251]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0246, loss_rel_change=-0.258]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0247, loss_rel_change=-0.255]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0246, loss_rel_change=-0.26]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0244, loss_rel_change=-0.265]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0244, loss_rel_change=-0.265]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0243, loss_rel_change=-0.267]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.024, loss_rel_change=-0.276]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.024, loss_rel_change=-0.277]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0238, loss_rel_change=-0.284]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0234, loss_rel_change=-0.295]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0235, loss_rel_change=-0.292]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0232, loss_rel_change=-0.301]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.023, loss_rel_change=-0.308]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0226, loss_rel_change=-0.32]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0221, loss_rel_change=-0.334]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0218, loss_rel_change=-0.343]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0216, loss_rel_change=-0.349]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0213, loss_rel_change=-0.359]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.021, loss_rel_change=-0.368]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0214, loss_rel_change=-0.355]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0203, loss_rel_change=-0.389]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0202, loss_rel_change=-0.393]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0202, loss_rel_change=-0.391]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.02, loss_rel_change=-0.399]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0196, loss_rel_change=-0.411]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0193, loss_rel_change=-0.418]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0195, loss_rel_change=-0.412]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0191, loss_rel_change=-0.424]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0189, loss_rel_change=-0.43]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0196, loss_rel_change=-0.409]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0192, loss_rel_change=-0.42]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0187, loss_rel_change=-0.436]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0192, loss_rel_change=-0.422]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0187, loss_rel_change=-0.436]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0183, loss_rel_change=-0.449]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0183, loss_rel_change=-0.449]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0185, loss_rel_change=-0.443]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0184, loss_rel_change=-0.446]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.018, loss_rel_change=-0.457]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0181, loss_rel_change=-0.454]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0178, loss_rel_change=-0.463]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0175, loss_rel_change=-0.473]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.018, loss_rel_change=-0.458]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0185, loss_rel_change=-0.443]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0171, loss_rel_change=-0.485]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.018, loss_rel_change=-0.457]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0182, loss_rel_change=-0.453]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0167, loss_rel_change=-0.497]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0173, loss_rel_change=-0.477]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0182, loss_rel_change=-0.452]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0171, loss_rel_change=-0.484]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.017, loss_rel_change=-0.488]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0173, loss_rel_change=-0.48]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0165, loss_rel_change=-0.502]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0161, loss_rel_change=-0.514]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0165, loss_rel_change=-0.502]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0169, loss_rel_change=-0.49]
Sparse reweighting progress: 15%|█▌ | 60/400 [00:00<00:00, 595.29epoch/s, loss=0.0159, loss_rel_change=-0.52]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0159, loss_rel_change=-0.52]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.016, loss_rel_change=-0.517]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0163, loss_rel_change=-0.508]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.016, loss_rel_change=-0.517]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0159, loss_rel_change=-0.522]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0161, loss_rel_change=-0.516]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0161, loss_rel_change=-0.514]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0156, loss_rel_change=-0.53]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.016, loss_rel_change=-0.518]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0158, loss_rel_change=-0.525]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0156, loss_rel_change=-0.53]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0159, loss_rel_change=-0.52]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0155, loss_rel_change=-0.534]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0159, loss_rel_change=-0.522]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0151, loss_rel_change=-0.545]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0151, loss_rel_change=-0.544]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0154, loss_rel_change=-0.537]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.015, loss_rel_change=-0.548]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0149, loss_rel_change=-0.551]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0149, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0147, loss_rel_change=-0.556]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0151, loss_rel_change=-0.544]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0147, loss_rel_change=-0.557]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0148, loss_rel_change=-0.556]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0164, loss_rel_change=-0.507]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0164, loss_rel_change=-0.507]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0147, loss_rel_change=-0.556]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0154, loss_rel_change=-0.535]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.015, loss_rel_change=-0.547]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0151, loss_rel_change=-0.546]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0152, loss_rel_change=-0.542]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0146, loss_rel_change=-0.561]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.015, loss_rel_change=-0.549]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0157, loss_rel_change=-0.528]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0155, loss_rel_change=-0.534]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0145, loss_rel_change=-0.562]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0147, loss_rel_change=-0.557]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0149, loss_rel_change=-0.551]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0152, loss_rel_change=-0.541]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.015, loss_rel_change=-0.548]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.015, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0149, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0144, loss_rel_change=-0.565]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0143, loss_rel_change=-0.568]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0148, loss_rel_change=-0.553]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0141, loss_rel_change=-0.575]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.014, loss_rel_change=-0.577]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0149, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0136, loss_rel_change=-0.59]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0161, loss_rel_change=-0.515]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.015, loss_rel_change=-0.548]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0136, loss_rel_change=-0.589]
Sparse reweighting progress: 30%|███ | 120/400 [00:00<00:00, 589.19epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.014, loss_rel_change=-0.577]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0139, loss_rel_change=-0.582]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0144, loss_rel_change=-0.566]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0137, loss_rel_change=-0.587]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.014, loss_rel_change=-0.578]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0133, loss_rel_change=-0.599]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0135, loss_rel_change=-0.594]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0133, loss_rel_change=-0.6]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0147, loss_rel_change=-0.557]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0139, loss_rel_change=-0.583]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0141, loss_rel_change=-0.576]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0149, loss_rel_change=-0.552]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0142, loss_rel_change=-0.572]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0144, loss_rel_change=-0.567]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0152, loss_rel_change=-0.542]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0144, loss_rel_change=-0.567]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0146, loss_rel_change=-0.56]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0132, loss_rel_change=-0.603]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0148, loss_rel_change=-0.556]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0133, loss_rel_change=-0.6]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.014, loss_rel_change=-0.578]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.013, loss_rel_change=-0.61]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0132, loss_rel_change=-0.603]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0135, loss_rel_change=-0.593]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0135, loss_rel_change=-0.593]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.013, loss_rel_change=-0.608]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0145, loss_rel_change=-0.563]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0133, loss_rel_change=-0.599]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0127, loss_rel_change=-0.617]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0138, loss_rel_change=-0.585]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0138, loss_rel_change=-0.584]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0126, loss_rel_change=-0.62]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0142, loss_rel_change=-0.573]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0135, loss_rel_change=-0.593]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0126, loss_rel_change=-0.62]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0136, loss_rel_change=-0.591]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0131, loss_rel_change=-0.604]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0131, loss_rel_change=-0.607]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0123, loss_rel_change=-0.63]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0124, loss_rel_change=-0.627]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0127, loss_rel_change=-0.618]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0126, loss_rel_change=-0.622]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0134, loss_rel_change=-0.597]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0127, loss_rel_change=-0.619]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0126, loss_rel_change=-0.62]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0125, loss_rel_change=-0.623]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0126, loss_rel_change=-0.621]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0123, loss_rel_change=-0.629]
Sparse reweighting progress: 45%|████▍ | 179/400 [00:00<00:00, 574.68epoch/s, loss=0.0124, loss_rel_change=-0.626]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0124, loss_rel_change=-0.626]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0124, loss_rel_change=-0.627]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0122, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0124, loss_rel_change=-0.626]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0125, loss_rel_change=-0.622]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0122, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0123, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0124, loss_rel_change=-0.625]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.637]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0121, loss_rel_change=-0.636]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0125, loss_rel_change=-0.622]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0124, loss_rel_change=-0.628]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0122, loss_rel_change=-0.632]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0122, loss_rel_change=-0.632]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.639]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.646]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.646]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0119, loss_rel_change=-0.642]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0121, loss_rel_change=-0.636]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0119, loss_rel_change=-0.642]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.639]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.645]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0123, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0119, loss_rel_change=-0.64]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0124, loss_rel_change=-0.626]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0124, loss_rel_change=-0.627]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.637]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0114, loss_rel_change=-0.657]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0123, loss_rel_change=-0.628]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.645]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0123, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0119, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0114, loss_rel_change=-0.655]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0116, loss_rel_change=-0.652]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0113, loss_rel_change=-0.659]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.639]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0116, loss_rel_change=-0.652]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0126, loss_rel_change=-0.622]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0118, loss_rel_change=-0.646]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 237/400 [00:00<00:00, 568.53epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0117, loss_rel_change=-0.646]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0114, loss_rel_change=-0.657]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0115, loss_rel_change=-0.655]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0114, loss_rel_change=-0.656]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0121, loss_rel_change=-0.635]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0114, loss_rel_change=-0.656]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0116, loss_rel_change=-0.652]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.666]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.011, loss_rel_change=-0.667]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0116, loss_rel_change=-0.65]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0112, loss_rel_change=-0.664]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0113, loss_rel_change=-0.66]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0113, loss_rel_change=-0.66]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.011, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.667]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0114, loss_rel_change=-0.657]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.011, loss_rel_change=-0.669]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.665]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.665]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.664]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0109, loss_rel_change=-0.671]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0109, loss_rel_change=-0.672]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.667]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0113, loss_rel_change=-0.659]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0109, loss_rel_change=-0.673]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.011, loss_rel_change=-0.669]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0108, loss_rel_change=-0.675]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0108, loss_rel_change=-0.676]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.666]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0111, loss_rel_change=-0.666]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0112, loss_rel_change=-0.662]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0109, loss_rel_change=-0.671]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0112, loss_rel_change=-0.664]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0106, loss_rel_change=-0.68]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.011, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0108, loss_rel_change=-0.675]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0107, loss_rel_change=-0.679]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0106, loss_rel_change=-0.681]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0107, loss_rel_change=-0.679]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 74%|███████▎ | 294/400 [00:00<00:00, 567.82epoch/s, loss=0.0105, loss_rel_change=-0.682]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.682]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0107, loss_rel_change=-0.678]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0104, loss_rel_change=-0.685]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0108, loss_rel_change=-0.675]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0106, loss_rel_change=-0.68]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0107, loss_rel_change=-0.677]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.685]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0104, loss_rel_change=-0.687]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0106, loss_rel_change=-0.681]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0107, loss_rel_change=-0.677]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0106, loss_rel_change=-0.68]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0103, loss_rel_change=-0.69]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0103, loss_rel_change=-0.689]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0104, loss_rel_change=-0.686]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0103, loss_rel_change=-0.689]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.685]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0104, loss_rel_change=-0.686]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0104, loss_rel_change=-0.688]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0103, loss_rel_change=-0.69]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0107, loss_rel_change=-0.679]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0102, loss_rel_change=-0.692]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0102, loss_rel_change=-0.692]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0104, loss_rel_change=-0.686]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0102, loss_rel_change=-0.691]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0101, loss_rel_change=-0.696]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0101, loss_rel_change=-0.694]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0101, loss_rel_change=-0.696]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0104, loss_rel_change=-0.685]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.01, loss_rel_change=-0.698]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0102, loss_rel_change=-0.693]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0102, loss_rel_change=-0.692]
Sparse reweighting progress: 88%|████████▊ | 352/400 [00:00<00:00, 571.23epoch/s, loss=0.0102, loss_rel_change=-0.693]
Sparse reweighting progress: 100%|██████████| 400/400 [00:00<00:00, 575.12epoch/s, loss=0.0102, loss_rel_change=-0.693]
L0 calibration results:
Non-zero weights: 1997 (39.9%)
Dataset reduction: 60.1%
Weight range: [0.000, 15.080]
Hyperparameter tuning for L0 regularization¶
Finding the optimal L0 regularization parameters is crucial for achieving the right balance between sparsity and calibration accuracy. This notebook demonstrates how to use the automatic hyperparameter tuning feature to find the best parameters for your specific dataset.
Why hyperparameter tuning matters¶
L0 regularization has three key parameters that interact in complex ways:
l0_lambda: Controls the strength of sparsity penalty
init_mean: Sets the initial proportion of active weights
temperature: Determines how “hard” the sparsity decisions are
Manual tuning can be time-consuming and may miss optimal combinations. The automatic tuning uses Optuna to efficiently search the parameter space.
Basic hyperparameter tuning¶
Let’s start with a simple tuning run to find good L0 parameters. The tuning process will:
Create multiple holdout sets for cross-validation
Try different parameter combinations
Evaluate each combination on both training and validation targets
Select the best parameters based on a multi-objective criterion
# Initialize calibration object
weights_init = np.ones(n_samples)
cal = Calibration(
weights=weights_init,
targets=targets,
estimate_matrix=estimate_matrix,
epochs=100, # Will be overridden during tuning
learning_rate=1e-3,
)
print("Starting hyperparameter tuning...")
print("This will take a few minutes as it explores different parameter combinations.\n")
# Run hyperparameter tuning
best_params = cal.tune_l0_hyperparameters(
n_trials=20, # Number of parameter combinations to try
objectives_balance={
'loss': 1.0, # Weight for calibration loss
'accuracy': 100.0, # Weight for accuracy (targets within 10%)
'sparsity': 10.0, # Weight for sparsity
},
n_holdout_sets=3, # Number of cross-validation folds
holdout_fraction=0.2, # Fraction of targets to hold out
epochs_per_trial=50, # Epochs per trial (faster for tuning)
)
print("\n" + "="*50)
print("Tuning completed!")
print("="*50)
Data leakage warning: Targets often share overlapping information (e.g., geographic breakdowns like 'snap in CA' and 'snap in US'). Holdout validation may not provide complete isolation between training and validation sets. The robustness metrics should be interpreted with this limitation in mind - they may overestimate the model's true generalization performance.
Starting hyperparameter tuning...
This will take a few minutes as it explores different parameter combinations.
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=19, weights_mean=5.93, weights_std=2.85, weights_min=1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=18.5, weights_mean=5.87, weights_std=2.82, weights_min=0.991]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=18.1, weights_mean=5.81, weights_std=2.8, weights_min=0.981]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=17.6, weights_mean=5.75, weights_std=2.77, weights_min=0.972]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=17.2, weights_mean=5.7, weights_std=2.74, weights_min=0.962]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1300.52epoch/s, loss=17.2, weights_mean=5.7, weights_std=2.74, weights_min=0.962]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0542, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0288, loss_rel_change=-0.468]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.047, loss_rel_change=-0.132]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0346, loss_rel_change=-0.362]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0331, loss_rel_change=-0.39]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0367, loss_rel_change=-0.324]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.034, loss_rel_change=-0.372]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0299, loss_rel_change=-0.448]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0329, loss_rel_change=-0.393]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0314, loss_rel_change=-0.42]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.475]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0297, loss_rel_change=-0.453]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.03, loss_rel_change=-0.447]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.029, loss_rel_change=-0.464]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0293, loss_rel_change=-0.459]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.471]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0298, loss_rel_change=-0.45]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0283, loss_rel_change=-0.479]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0284, loss_rel_change=-0.476]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0285, loss_rel_change=-0.475]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0283, loss_rel_change=-0.478]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.483]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.98epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.484]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.484]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.484]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.484]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0279, loss_rel_change=-0.485]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0279, loss_rel_change=-0.485]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0279, loss_rel_change=-0.485]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0279, loss_rel_change=-0.486]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.028, loss_rel_change=-0.484]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0279, loss_rel_change=-0.485]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.96epoch/s, loss=0.0279, loss_rel_change=-0.485]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 349.61epoch/s, loss=0.0279, loss_rel_change=-0.485]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=74.4, weights_mean=10.6, weights_std=3.99, weights_min=1.09]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=72.7, weights_mean=10.5, weights_std=3.95, weights_min=1.08]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=71.1, weights_mean=10.4, weights_std=3.91, weights_min=1.07]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=69.6, weights_mean=10.3, weights_std=3.87, weights_min=1.06]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=68, weights_mean=10.2, weights_std=3.83, weights_min=1.05]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1446.89epoch/s, loss=68, weights_mean=10.2, weights_std=3.83, weights_min=1.05]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.6, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.88, loss_rel_change=-0.423]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.54, loss_rel_change=-0.667]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.52, loss_rel_change=-0.816]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.38, loss_rel_change=-0.899]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.75, loss_rel_change=-0.945]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.372, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.166, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0753, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0353, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0379, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0561, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0752, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.105, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.126, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.147, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.188, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.205, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.224, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.235, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.243, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.251, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.26, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.266, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.273, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.271, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.277, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.281, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.277, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.274, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.277, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.273, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.275, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.266, loss_rel_change=-0.98]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.266, loss_rel_change=-0.98]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.257, loss_rel_change=-0.981]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.252, loss_rel_change=-0.982]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.251, loss_rel_change=-0.982]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.246, loss_rel_change=-0.982]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.238, loss_rel_change=-0.983]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.237, loss_rel_change=-0.983]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.224, loss_rel_change=-0.984]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.223, loss_rel_change=-0.984]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.215, loss_rel_change=-0.984]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.209, loss_rel_change=-0.985]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.2, loss_rel_change=-0.985]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.199, loss_rel_change=-0.985]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.183, loss_rel_change=-0.987]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.177, loss_rel_change=-0.987]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.17, loss_rel_change=-0.988]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.163, loss_rel_change=-0.988]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.152, loss_rel_change=-0.989]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.145, loss_rel_change=-0.989]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.14, loss_rel_change=-0.99]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.127, loss_rel_change=-0.991]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.119, loss_rel_change=-0.991]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.112, loss_rel_change=-0.992]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.106, loss_rel_change=-0.992]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0988, loss_rel_change=-0.993]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0914, loss_rel_change=-0.993]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0879, loss_rel_change=-0.994]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0822, loss_rel_change=-0.994]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0746, loss_rel_change=-0.995]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0687, loss_rel_change=-0.995]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0655, loss_rel_change=-0.995]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0599, loss_rel_change=-0.996]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0533, loss_rel_change=-0.996]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0489, loss_rel_change=-0.996]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0451, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0441, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.26epoch/s, loss=0.0403, loss_rel_change=-0.997]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0403, loss_rel_change=-0.997]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0361, loss_rel_change=-0.997]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0351, loss_rel_change=-0.997]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.034, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0323, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.031, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.03, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.029, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0285, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0286, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0284, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0281, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0283, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0287, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0287, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0288, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0289, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.029, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0295, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0296, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0297, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0295, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0292, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0292, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0299, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0292, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0296, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0293, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 353.13epoch/s, loss=0.0297, loss_rel_change=-0.998]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 351.77epoch/s, loss=0.0297, loss_rel_change=-0.998]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=162, weights_mean=15.1, weights_std=4.77, weights_min=1.54]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=158, weights_mean=15, weights_std=4.72, weights_min=1.52]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=155, weights_mean=14.8, weights_std=4.67, weights_min=1.51]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=151, weights_mean=14.7, weights_std=4.63, weights_min=1.49]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=148, weights_mean=14.5, weights_std=4.58, weights_min=1.48]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1443.02epoch/s, loss=148, weights_mean=14.5, weights_std=4.58, weights_min=1.48]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=55.4, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.5, loss_rel_change=-0.377]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.9, loss_rel_change=-0.624]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.1, loss_rel_change=-0.764]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.22, loss_rel_change=-0.852]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.15, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.16, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.06, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.27, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.812, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.496, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.302, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.103, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0598, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0374, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0292, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0337, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0433, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0532, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0683, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0771, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0878, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0999, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.11, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.133, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.137, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.144, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.148, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.155, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.161, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.168, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.171, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.175, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.181, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.18, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.179, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.184, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.185, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.187, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.179, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.182, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.189, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.185, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.182, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.18, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.183, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.179, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.184, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.174, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.173, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.171, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.169, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.167, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.165, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.165, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.163, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.155, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.161, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.159, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.149, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.151, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.143, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.147, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.143, loss_rel_change=-0.997]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.138, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.136, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.136, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.134, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.73epoch/s, loss=0.128, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.128, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.128, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.126, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.118, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.117, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.114, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.116, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.113, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.108, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.105, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.101, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.101, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.1, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.094, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0918, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0938, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.088, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0893, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.083, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.084, loss_rel_change=-0.998]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0788, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0771, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0762, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0731, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0749, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0735, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0701, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0695, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.91epoch/s, loss=0.0652, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 344.46epoch/s, loss=0.0652, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=274, weights_mean=19.4, weights_std=5.43, weights_min=2.16]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=268, weights_mean=19.2, weights_std=5.37, weights_min=2.14]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=263, weights_mean=19, weights_std=5.32, weights_min=2.12]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=257, weights_mean=18.8, weights_std=5.27, weights_min=2.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=252, weights_mean=18.6, weights_std=5.22, weights_min=2.08]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1435.46epoch/s, loss=252, weights_mean=18.6, weights_std=5.22, weights_min=2.08]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=41.5, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.9, loss_rel_change=-0.473]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.5, loss_rel_change=-0.699]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.6, loss_rel_change=-0.841]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.85, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.06, loss_rel_change=-0.95]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.881, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.524, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.281, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.114, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.073, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0534, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0595, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0771, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0943, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.141, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.21, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.244, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.281, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.306, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.341, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.324, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.331, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.341, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.334, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.347, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.376, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.361, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.374, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.39, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.375, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.379, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.358, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.358, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.366, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.372, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.377, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.364, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.375, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.36, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.369, loss_rel_change=-0.991]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.32, loss_rel_change=-0.992]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.328, loss_rel_change=-0.992]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.311, loss_rel_change=-0.993]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.325, loss_rel_change=-0.992]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.318, loss_rel_change=-0.992]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.315, loss_rel_change=-0.992]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.299, loss_rel_change=-0.993]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.288, loss_rel_change=-0.993]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.3, loss_rel_change=-0.993]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.276, loss_rel_change=-0.993]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.267, loss_rel_change=-0.994]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.238, loss_rel_change=-0.994]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.201, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.184, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.142, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.138, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.123, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.141, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.103, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.103, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.104, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0996, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0888, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0632, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0728, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0655, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0613, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0701, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0679, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.90epoch/s, loss=0.0635, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0635, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0569, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0658, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.069, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0546, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0568, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0551, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0578, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0574, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0577, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0531, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0586, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0601, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0552, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0614, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.058, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0503, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0568, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0539, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0517, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.054, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0578, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.049, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0531, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0477, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0503, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.39epoch/s, loss=0.0483, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 349.45epoch/s, loss=0.0483, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=409, weights_mean=23.4, weights_std=5.94, weights_min=6.29]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=401, weights_mean=23.2, weights_std=5.88, weights_min=6.23]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=392, weights_mean=23, weights_std=5.82, weights_min=6.17]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=384, weights_mean=22.7, weights_std=5.76, weights_min=6.11]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=377, weights_mean=22.5, weights_std=5.71, weights_min=6.05]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1312.80epoch/s, loss=377, weights_mean=22.5, weights_std=5.71, weights_min=6.05]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=72.3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=39.2, loss_rel_change=-0.458]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.7, loss_rel_change=-0.673]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.1, loss_rel_change=-0.818]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.13, loss_rel_change=-0.888]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.66, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.4, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.44, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.829, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.395, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.261, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.104, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0604, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0515, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.057, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0646, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0996, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.104, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.156, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.208, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.203, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.237, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.229, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.271, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.242, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.314, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.3, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.302, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.318, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.321, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.324, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.33, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.337, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.34, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.319, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.342, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.342, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.35, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.357, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.36, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.362, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.364, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.373, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.347, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.362, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.316, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.345, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.339, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.356, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.329, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.319, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.345, loss_rel_change=-0.995]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.322, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.291, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.292, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.311, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.278, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.301, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.31, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.287, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.269, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.291, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.294, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.274, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.283, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.283, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.228, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.256, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.246, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.256, loss_rel_change=-0.996]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.245, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.246, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.229, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 365.37epoch/s, loss=0.209, loss_rel_change=-0.997]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.209, loss_rel_change=-0.997]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.21, loss_rel_change=-0.997]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.201, loss_rel_change=-0.997]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.205, loss_rel_change=-0.997]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.17, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.189, loss_rel_change=-0.997]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.172, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.139, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.137, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.117, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.1, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.101, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.199, loss_rel_change=-0.997]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.155, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.135, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0941, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0976, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.073, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0712, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0719, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0828, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0669, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0784, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0697, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0671, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0754, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 333.24epoch/s, loss=0.0579, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 339.54epoch/s, loss=0.0579, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=564, weights_mean=27.3, weights_std=6.34, weights_min=6.96]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=552, weights_mean=27.1, weights_std=6.27, weights_min=6.89]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=541, weights_mean=26.8, weights_std=6.21, weights_min=6.82]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=530, weights_mean=26.5, weights_std=6.15, weights_min=6.76]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=519, weights_mean=26.3, weights_std=6.09, weights_min=6.69]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1448.40epoch/s, loss=519, weights_mean=26.3, weights_std=6.09, weights_min=6.69]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=110, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=62.1, loss_rel_change=-0.434]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=36.4, loss_rel_change=-0.668]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.2, loss_rel_change=-0.797]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.4, loss_rel_change=-0.887]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.52, loss_rel_change=-0.931]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.53, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.85, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.66, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.848, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.515, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.285, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.137, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0725, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0652, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0544, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0562, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0671, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0875, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0793, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.111, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.133, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.171, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.17, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.213, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.232, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.235, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.223, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.26, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.264, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.251, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.275, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.257, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.295, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.312, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.312, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.304, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.293, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.31, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.277, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.317, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.3, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.306, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.308, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.303, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.32, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.273, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.308, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.318, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.291, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.296, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.284, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.311, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.289, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.257, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.282, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.313, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.281, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.291, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.283, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.274, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.264, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.278, loss_rel_change=-0.997]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.27, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.266, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.232, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.228, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.236, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.271, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.234, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.257, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.229, loss_rel_change=-0.998]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 367.69epoch/s, loss=0.223, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.223, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.253, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.206, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.231, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.235, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.242, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.219, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.214, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.204, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.202, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.177, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.208, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.191, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.19, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.21, loss_rel_change=-0.998]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.152, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.163, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.163, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.154, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.16, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.155, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.137, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.14, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.143, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.156, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.155, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.03epoch/s, loss=0.122, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 360.59epoch/s, loss=0.122, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=738, weights_mean=31.1, weights_std=6.7, weights_min=8.33]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=723, weights_mean=30.8, weights_std=6.63, weights_min=8.25]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=708, weights_mean=30.5, weights_std=6.57, weights_min=8.17]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=694, weights_mean=30.2, weights_std=6.5, weights_min=8.09]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=680, weights_mean=29.9, weights_std=6.44, weights_min=8.01]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1425.02epoch/s, loss=680, weights_mean=29.9, weights_std=6.44, weights_min=8.01]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=374, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=237, loss_rel_change=-0.367]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=150, loss_rel_change=-0.598]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=97.4, loss_rel_change=-0.739]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=64.5, loss_rel_change=-0.827]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=43.2, loss_rel_change=-0.884]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.6, loss_rel_change=-0.923]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.6, loss_rel_change=-0.948]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.2, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.72, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.3, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.17, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.94, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.85, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.22, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.62, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.24, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.06, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.747, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.549, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.453, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.345, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.282, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.203, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.13, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0982, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.083, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0593, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0496, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0356, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0278, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0229, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0186, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.012, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0111, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00756, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00706, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00667, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00652, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00663, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00714, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00669, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00704, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0079, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00831, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0075, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0086, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0086, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00908, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0075, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00777, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00929, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00942, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00887, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00928, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0107, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00962, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00961, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0119, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0122, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.00959, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.88epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00973, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00887, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0107, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00975, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00963, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00878, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00881, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0111, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00914, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0131, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0104, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00894, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00989, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0111, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00981, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.00983, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 358.10epoch/s, loss=0.012, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 357.60epoch/s, loss=0.012, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=923, weights_mean=34.6, weights_std=7, weights_min=9.98]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=904, weights_mean=34.2, weights_std=6.93, weights_min=9.88]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=886, weights_mean=33.9, weights_std=6.87, weights_min=9.78]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=868, weights_mean=33.6, weights_std=6.8, weights_min=9.68]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=850, weights_mean=33.2, weights_std=6.73, weights_min=9.59]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1447.30epoch/s, loss=850, weights_mean=33.2, weights_std=6.73, weights_min=9.59]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=482, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=304, loss_rel_change=-0.37]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=196, loss_rel_change=-0.594]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=129, loss_rel_change=-0.733]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=84.7, loss_rel_change=-0.824]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=55.2, loss_rel_change=-0.886]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38.8, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.4, loss_rel_change=-0.945]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.1, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.1, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.27, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.32, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.26, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.21, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.34, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.96, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.49, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.17, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.943, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.747, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.597, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.496, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.391, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.307, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.244, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.234, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.126, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.11, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0924, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0807, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0666, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0554, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0518, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0435, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0435, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0402, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0241, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0237, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0222, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0191, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.018, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.021, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0135, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0182, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00858, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00914, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0117, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00834, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00981, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00832, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00883, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00728, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00777, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00945, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00785, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00728, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00808, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0085, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00979, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00676, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00749, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00734, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00725, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00696, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00749, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00716, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00695, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.00689, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 368.16epoch/s, loss=0.0068, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.0068, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00708, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00735, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00741, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00717, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00683, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00678, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00701, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00657, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00677, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00687, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.0066, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00709, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00711, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00718, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00686, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00692, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00666, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00681, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00739, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00692, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00706, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00671, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00683, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00684, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00727, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 362.19epoch/s, loss=0.00717, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 358.67epoch/s, loss=0.00717, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.12e+3, weights_mean=38, weights_std=7.3, weights_min=15.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.09e+3, weights_mean=37.6, weights_std=7.22, weights_min=15.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.07e+3, weights_mean=37.2, weights_std=7.15, weights_min=15]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.05e+3, weights_mean=36.9, weights_std=7.08, weights_min=14.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.03e+3, weights_mean=36.5, weights_std=7.01, weights_min=14.7]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1425.54epoch/s, loss=1.03e+3, weights_mean=36.5, weights_std=7.01, weights_min=14.7]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=607, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=388, loss_rel_change=-0.361]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=246, loss_rel_change=-0.595]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=161, loss_rel_change=-0.734]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=106, loss_rel_change=-0.825]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=73, loss_rel_change=-0.88]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=48.4, loss_rel_change=-0.92]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.1, loss_rel_change=-0.942]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.8, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.3, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.76, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.53, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.71, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.57, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.45, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.69, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.13, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.67, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.5, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.16, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.972, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.812, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.64, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.583, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.463, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.378, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.347, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.271, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.225, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.208, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.181, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.117, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0884, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0884, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0858, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0826, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0834, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0619, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0616, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0624, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0494, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0425, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0451, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.043, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0358, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0338, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0324, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0403, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.031, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0298, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0347, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0267, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0228, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0268, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0195, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0301, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.026, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0258, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0216, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0207, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0164, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0175, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0227, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0178, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0215, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0216, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0197, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0181, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0207, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0233, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.75epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0169, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0196, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0169, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0157, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0198, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0171, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0162, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0187, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.013, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0122, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0175, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0159, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0166, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0195, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0195, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.015, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0139, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0139, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0145, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0139, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.88epoch/s, loss=0.0122, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 360.61epoch/s, loss=0.0122, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.32e+3, weights_mean=41.2, weights_std=7.46, weights_min=15.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.3e+3, weights_mean=40.8, weights_std=7.39, weights_min=15.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.27e+3, weights_mean=40.4, weights_std=7.31, weights_min=15.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.25e+3, weights_mean=40, weights_std=7.24, weights_min=15.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.22e+3, weights_mean=39.6, weights_std=7.17, weights_min=15.2]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1426.96epoch/s, loss=1.22e+3, weights_mean=39.6, weights_std=7.17, weights_min=15.2]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=246, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=142, loss_rel_change=-0.42]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=83.5, loss_rel_change=-0.66]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=52, loss_rel_change=-0.788]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=32.1, loss_rel_change=-0.87]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.2, loss_rel_change=-0.918]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13, loss_rel_change=-0.947]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.34, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.63, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.69, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.58, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.73, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.16, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.893, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.62, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.444, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.355, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.245, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.224, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.139, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.144, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.163, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.161, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.164, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.187, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.187, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.176, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.185, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.185, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.199, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.19, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.195, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.195, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.197, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.194, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.206, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.201, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.203, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.205, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.207, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.214, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.21, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.199, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.194, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.211, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.21, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.21, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.213, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.205, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.203, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.199, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.203, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.196, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.212, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.209, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.199, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.25epoch/s, loss=0.195, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.195, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.201, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.189, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.203, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.191, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.191, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.196, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.194, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.193, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.195, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.192, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.181, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.188, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.181, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.176, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.178, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.186, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.177, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.177, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 359.09epoch/s, loss=0.18, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 357.25epoch/s, loss=0.18, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.53e+3, weights_mean=44.2, weights_std=7.67, weights_min=18]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.5e+3, weights_mean=43.8, weights_std=7.59, weights_min=17.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.47e+3, weights_mean=43.4, weights_std=7.52, weights_min=17.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.44e+3, weights_mean=42.9, weights_std=7.45, weights_min=17.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.41e+3, weights_mean=42.5, weights_std=7.37, weights_min=17.3]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1420.32epoch/s, loss=1.41e+3, weights_mean=42.5, weights_std=7.37, weights_min=17.3]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=291, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=167, loss_rel_change=-0.425]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=99.7, loss_rel_change=-0.657]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=61.7, loss_rel_change=-0.788]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=37.6, loss_rel_change=-0.871]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.7, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.4, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.3, loss_rel_change=-0.965]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.61, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.81, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.08, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.24, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.23, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.833, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.556, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.49, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.374, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.3, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.236, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.173, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.151, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.151, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.151, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.156, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.153, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.157, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.167, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.182, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.177, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.176, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.197, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.178, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.187, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.174, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.187, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.183, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.189, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.197, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.182, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.181, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.189, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.186, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.186, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.183, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.183, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.173, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.189, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 363.69epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.183, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.178, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.177, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.178, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.176, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.176, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.165, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.162, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.166, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.167, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.176, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.162, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.159, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 357.43epoch/s, loss=0.162, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 355.69epoch/s, loss=0.162, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.75e+3, weights_mean=47.2, weights_std=7.81, weights_min=18.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.71e+3, weights_mean=46.7, weights_std=7.73, weights_min=18.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.68e+3, weights_mean=46.3, weights_std=7.65, weights_min=18]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.64e+3, weights_mean=45.8, weights_std=7.58, weights_min=17.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.61e+3, weights_mean=45.4, weights_std=7.5, weights_min=17.6]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1426.23epoch/s, loss=1.61e+3, weights_mean=45.4, weights_std=7.5, weights_min=17.6]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=333, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=196, loss_rel_change=-0.413]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=119, loss_rel_change=-0.643]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=70.4, loss_rel_change=-0.789]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=45.2, loss_rel_change=-0.865]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.9, loss_rel_change=-0.916]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.5, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.36, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.71, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.07, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.76, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.92, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.52, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.08, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.802, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.599, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.463, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.328, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.268, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.223, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.183, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.12, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.126, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.155, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.16, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.155, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.169, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.167, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.155, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.174, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.162, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.166, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 364.22epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.166, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.168, loss_rel_change=-0.999]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.16, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.162, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.156, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.156, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.155, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 358.57epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 356.72epoch/s, loss=0.148, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.96e+3, weights_mean=49.9, weights_std=8, weights_min=20.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.93e+3, weights_mean=49.5, weights_std=7.92, weights_min=20.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.89e+3, weights_mean=49, weights_std=7.84, weights_min=20.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.85e+3, weights_mean=48.5, weights_std=7.77, weights_min=20]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=1.81e+3, weights_mean=48, weights_std=7.69, weights_min=19.8]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1389.94epoch/s, loss=1.81e+3, weights_mean=48, weights_std=7.69, weights_min=19.8]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=533, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=323, loss_rel_change=-0.394]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=176, loss_rel_change=-0.67]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=116, loss_rel_change=-0.783]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74.2, loss_rel_change=-0.861]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.6, loss_rel_change=-0.911]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.7, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.2, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.9, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.97, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.37, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.81, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.06, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.97, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.69, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.23, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.934, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.655, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.571, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.403, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.298, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.286, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.251, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.166, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.154, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.126, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.126, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.131, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.141, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.155, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.156, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.162, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.16, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.155, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.15, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.156, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.156, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.149, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.154, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.177, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.172, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 362.80epoch/s, loss=0.156, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.156, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.16, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.171, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.172, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.162, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.155, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 360.03epoch/s, loss=0.154, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 350.59epoch/s, loss=0.154, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.17e+3, weights_mean=52.5, weights_std=8.16, weights_min=26.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.13e+3, weights_mean=52, weights_std=8.08, weights_min=25.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.08e+3, weights_mean=51.5, weights_std=8, weights_min=25.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.04e+3, weights_mean=51, weights_std=7.92, weights_min=25.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2e+3, weights_mean=50.5, weights_std=7.84, weights_min=25.2]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1383.50epoch/s, loss=2e+3, weights_mean=50.5, weights_std=7.84, weights_min=25.2]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=587, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=369, loss_rel_change=-0.371]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=211, loss_rel_change=-0.64]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=124, loss_rel_change=-0.789]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=83.7, loss_rel_change=-0.857]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=52.9, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.7, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.7, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.4, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.4, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.22, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.42, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.61, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.88, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.01, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.45, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.11, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.685, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.654, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.467, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.412, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.299, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.326, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.231, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.176, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.154, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.13, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.13, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.154, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.141, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.154, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 357.43epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.169, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.131, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.141, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.131, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 354.99epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 353.24epoch/s, loss=0.144, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.39e+3, weights_mean=55, weights_std=8.36, weights_min=26.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.34e+3, weights_mean=54.5, weights_std=8.28, weights_min=26.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.29e+3, weights_mean=53.9, weights_std=8.19, weights_min=26.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.25e+3, weights_mean=53.4, weights_std=8.11, weights_min=25.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.2e+3, weights_mean=52.9, weights_std=8.03, weights_min=25.7]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1394.14epoch/s, loss=2.2e+3, weights_mean=52.9, weights_std=8.03, weights_min=25.7]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=659, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=377, loss_rel_change=-0.427]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=249, loss_rel_change=-0.622]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=153, loss_rel_change=-0.768]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=92.3, loss_rel_change=-0.86]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=54.4, loss_rel_change=-0.917]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=37, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.7, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.8, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.17, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.17, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.36, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.91, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.66, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.26, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.876, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.652, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.581, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.465, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.37, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.269, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.246, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.214, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.194, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.12, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.119, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.118, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.126, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.131, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.122, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.126, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.13, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.62epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.131, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.13, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.13epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 354.59epoch/s, loss=0.139, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.61e+3, weights_mean=57.4, weights_std=8.46, weights_min=28.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.56e+3, weights_mean=56.8, weights_std=8.38, weights_min=27.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.51e+3, weights_mean=56.3, weights_std=8.3, weights_min=27.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.46e+3, weights_mean=55.7, weights_std=8.22, weights_min=27.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.41e+3, weights_mean=55.2, weights_std=8.14, weights_min=27]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1384.12epoch/s, loss=2.41e+3, weights_mean=55.2, weights_std=8.14, weights_min=27]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=784, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=460, loss_rel_change=-0.413]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=280, loss_rel_change=-0.643]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=178, loss_rel_change=-0.773]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=111, loss_rel_change=-0.858]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74.1, loss_rel_change=-0.905]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.2, loss_rel_change=-0.94]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=31.1, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.3, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.7, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.2, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.38, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.56, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.52, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.08, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.42, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.76, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.53, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.04, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.744, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.587, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.423, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.334, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.235, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0888, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.11, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0827, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0599, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0859, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0451, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0373, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0327, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0327, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0327, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.02, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0142, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0183, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0177, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0098, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0117, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.00934, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.00993, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.00932, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0123, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0117, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0119, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.00998, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0151, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.00987, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.00988, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0156, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0104, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0119, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 358.30epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0107, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0155, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.011, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0146, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0123, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.012, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.012, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0097, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.00973, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0113, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.011, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0127, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0124, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0126, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.013, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.64epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 352.84epoch/s, loss=0.0109, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.82e+3, weights_mean=59.7, weights_std=8.5, weights_min=33.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.76e+3, weights_mean=59.1, weights_std=8.41, weights_min=32.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.71e+3, weights_mean=58.5, weights_std=8.33, weights_min=32.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.65e+3, weights_mean=58, weights_std=8.25, weights_min=32.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.6e+3, weights_mean=57.4, weights_std=8.17, weights_min=31.8]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1415.43epoch/s, loss=2.6e+3, weights_mean=57.4, weights_std=8.17, weights_min=31.8]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=858, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=506, loss_rel_change=-0.41]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=303, loss_rel_change=-0.648]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=189, loss_rel_change=-0.78]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=118, loss_rel_change=-0.862]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=77.7, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=51.1, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.7, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.3, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.5, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.6, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.45, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.33, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.31, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.32, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.65, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.95, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.58, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.19, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.915, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.606, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.521, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.383, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.358, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.282, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.216, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.197, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0971, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0957, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0803, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0815, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0674, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0528, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0464, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0406, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0406, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0253, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0369, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0212, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0275, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0254, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0277, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0153, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0192, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0153, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0096, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0111, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.011, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0118, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0134, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.00941, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0119, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0107, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.00945, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.00978, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0091, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0115, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0127, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.00988, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.00989, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0118, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 361.50epoch/s, loss=0.0145, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0145, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00972, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0124, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0104, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0104, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00928, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0117, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0131, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00983, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0133, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0125, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0096, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0115, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00981, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0131, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00934, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0107, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00978, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00938, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.00986, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 347.61epoch/s, loss=0.0126, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 342.29epoch/s, loss=0.0126, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.05e+3, weights_mean=61.9, weights_std=8.61, weights_min=32.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.99e+3, weights_mean=61.3, weights_std=8.52, weights_min=32.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.93e+3, weights_mean=60.7, weights_std=8.44, weights_min=32]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.87e+3, weights_mean=60.1, weights_std=8.35, weights_min=31.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=2.81e+3, weights_mean=59.5, weights_std=8.27, weights_min=31.4]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1377.98epoch/s, loss=2.81e+3, weights_mean=59.5, weights_std=8.27, weights_min=31.4]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=916, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=550, loss_rel_change=-0.399]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=333, loss_rel_change=-0.637]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=203, loss_rel_change=-0.778]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=129, loss_rel_change=-0.859]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=84.5, loss_rel_change=-0.908]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=55.4, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=39.1, loss_rel_change=-0.957]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.6, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.4, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.62, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.18, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.13, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.95, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.35, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.35, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.77, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.46, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.09, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.06, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.617, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.556, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.481, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.396, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.352, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.282, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.109, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0975, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0965, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0719, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0719, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0288, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0339, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0467, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0293, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0407, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0322, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0316, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0325, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0212, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.028, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0196, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0206, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0206, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0184, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0168, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0159, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0124, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0115, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0116, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0144, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0159, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.012, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0141, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.018, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.00955, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0125, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0146, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.87epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0115, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0118, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00981, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00934, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0113, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00961, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0118, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0123, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00973, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00913, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0116, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0117, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0111, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0113, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0094, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00932, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00971, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00907, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00986, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.00984, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0115, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.69epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 343.47epoch/s, loss=0.0114, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.26e+3, weights_mean=64, weights_std=8.75, weights_min=31.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.2e+3, weights_mean=63.3, weights_std=8.67, weights_min=31.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.13e+3, weights_mean=62.7, weights_std=8.58, weights_min=31.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.07e+3, weights_mean=62.1, weights_std=8.5, weights_min=30.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.01e+3, weights_mean=61.5, weights_std=8.41, weights_min=30.5]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1433.14epoch/s, loss=3.01e+3, weights_mean=61.5, weights_std=8.41, weights_min=30.5]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=955, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=558, loss_rel_change=-0.416]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=354, loss_rel_change=-0.629]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=219, loss_rel_change=-0.771]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=136, loss_rel_change=-0.857]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=89, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.9, loss_rel_change=-0.94]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=39.4, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.9, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.7, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.3, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.24, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.06, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.18, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.52, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.64, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.16, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.55, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.38, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.818, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.701, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.645, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.52, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.435, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.387, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.252, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.261, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.24, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.186, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.106, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.106, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0922, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0769, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.079, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0709, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0597, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0574, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0582, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0638, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0497, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0478, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0475, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0427, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0392, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0484, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.039, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.034, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0443, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0451, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.041, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.047, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0422, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0398, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0308, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0386, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0346, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0345, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0416, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.032, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0323, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0378, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0415, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0436, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0433, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0352, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.25epoch/s, loss=0.0328, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0328, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0372, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0366, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0374, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0318, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0406, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0358, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.034, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0348, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0378, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.037, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0333, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0308, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0317, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0405, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0417, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0334, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0322, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.035, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0338, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0326, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0325, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0383, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.031, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0324, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0338, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0341, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0337, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 343.21epoch/s, loss=0.0303, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 340.23epoch/s, loss=0.0303, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.46e+3, weights_mean=65.9, weights_std=8.83, weights_min=31.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.39e+3, weights_mean=65.2, weights_std=8.74, weights_min=31.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.32e+3, weights_mean=64.6, weights_std=8.65, weights_min=31.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.25e+3, weights_mean=63.9, weights_std=8.57, weights_min=30.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.19e+3, weights_mean=63.3, weights_std=8.48, weights_min=30.6]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1420.57epoch/s, loss=3.19e+3, weights_mean=63.3, weights_std=8.48, weights_min=30.6]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.02e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=613, loss_rel_change=-0.401]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=378, loss_rel_change=-0.631]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=234, loss_rel_change=-0.771]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=146, loss_rel_change=-0.857]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=93.2, loss_rel_change=-0.909]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=63.4, loss_rel_change=-0.938]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=42.7, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.5, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.6, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.1, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.7, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.63, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.15, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.78, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.54, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.74, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.24, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.81, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.48, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.22, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.997, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.84, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.681, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.577, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.431, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.393, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.343, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.301, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.301, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.222, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.109, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.109, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.149, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.117, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0923, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0801, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.1, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0835, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0668, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0575, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0664, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0696, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0624, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0613, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0587, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0663, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0459, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0542, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0517, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0447, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0459, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0583, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0464, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0436, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0447, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0416, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0529, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0456, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0473, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.045, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0383, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0397, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0412, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0383, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0355, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.04, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0381, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.86epoch/s, loss=0.0382, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0382, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0437, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.046, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0357, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0425, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0402, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0461, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.038, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0472, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0348, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0343, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0347, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0328, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0405, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0367, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0382, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0485, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0393, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0447, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0403, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0349, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0358, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0349, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0373, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0348, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0355, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0393, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0416, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0425, loss_rel_change=-1]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 351.87epoch/s, loss=0.0383, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 351.45epoch/s, loss=0.0383, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.67e+3, weights_mean=67.7, weights_std=8.83, weights_min=35.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.6e+3, weights_mean=67.1, weights_std=8.75, weights_min=35]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.52e+3, weights_mean=66.4, weights_std=8.66, weights_min=34.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.45e+3, weights_mean=65.7, weights_std=8.57, weights_min=34.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.39e+3, weights_mean=65.1, weights_std=8.49, weights_min=34]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1429.37epoch/s, loss=3.39e+3, weights_mean=65.1, weights_std=8.49, weights_min=34]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.08e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=645, loss_rel_change=-0.401]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=390, loss_rel_change=-0.638]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=249, loss_rel_change=-0.768]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=162, loss_rel_change=-0.85]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=102, loss_rel_change=-0.905]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=68.3, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.3, loss_rel_change=-0.956]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=30.9, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.8, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.3, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.4, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.52, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.97, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.83, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.23, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.91, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.57, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.88, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.55, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.19, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.07, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.869, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.623, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.685, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.549, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.438, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.422, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.321, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.284, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.268, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.274, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.197, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.153, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0878, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.105, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.114, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0853, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.105, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0742, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0648, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0893, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0772, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.061, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0688, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0623, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0686, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0768, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0498, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0448, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0582, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.045, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0602, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0529, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0521, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0585, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0576, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0567, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0505, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.043, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.045, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0505, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0443, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0443, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0425, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.043, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0462, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.048, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0394, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0608, loss_rel_change=-1]
Sparse reweighting progress: 37%|███▋ | 37/100 [00:00<00:00, 360.13epoch/s, loss=0.0408, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0408, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0429, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0466, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0431, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0392, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0459, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0398, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0456, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0407, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0369, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0365, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0409, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0384, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0395, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0416, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0473, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0481, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0392, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0385, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0422, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.045, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0457, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0382, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0424, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0404, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0404, loss_rel_change=-1]
Sparse reweighting progress: 74%|███████▍ | 74/100 [00:00<00:00, 356.51epoch/s, loss=0.0413, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 349.19epoch/s, loss=0.0413, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.88e+3, weights_mean=69.6, weights_std=8.96, weights_min=38.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.8e+3, weights_mean=68.9, weights_std=8.87, weights_min=38.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.72e+3, weights_mean=68.2, weights_std=8.78, weights_min=38.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.65e+3, weights_mean=67.5, weights_std=8.69, weights_min=37.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.58e+3, weights_mean=66.9, weights_std=8.61, weights_min=37.4]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1290.17epoch/s, loss=3.58e+3, weights_mean=66.9, weights_std=8.61, weights_min=37.4]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.24e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=730, loss_rel_change=-0.411]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=459, loss_rel_change=-0.63]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=270, loss_rel_change=-0.782]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=171, loss_rel_change=-0.862]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=111, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74.4, loss_rel_change=-0.94]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=48, loss_rel_change=-0.961]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.1, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25.2, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.9, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.84, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.03, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.52, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.29, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.37, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.62, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.08, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.77, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.37, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.2, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.803, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.748, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.578, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.588, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.452, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.417, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.329, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.277, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.231, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.206, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.195, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.12, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0931, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0931, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.115, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0926, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0477, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0788, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0565, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0456, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0398, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0246, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0678, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0261, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0607, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0317, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0462, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0578, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0285, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0237, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0301, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0394, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.033, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0284, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.019, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.02, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0258, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0322, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0329, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0227, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0269, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0302, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0197, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.029, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0238, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.022, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0184, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0184, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0286, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0259, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0223, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0213, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.017, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0256, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0181, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0163, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.00959, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.013, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0207, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0208, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0233, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0126, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0185, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0161, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0182, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.02, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.018, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0172, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0248, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0276, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0198, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0271, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0211, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.97epoch/s, loss=0.0203, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 353.18epoch/s, loss=0.0203, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.07e+3, weights_mean=71.3, weights_std=8.97, weights_min=39.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.99e+3, weights_mean=70.6, weights_std=8.89, weights_min=38.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.91e+3, weights_mean=69.9, weights_std=8.8, weights_min=38.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.83e+3, weights_mean=69.2, weights_std=8.71, weights_min=37.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.75e+3, weights_mean=68.5, weights_std=8.63, weights_min=37.6]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1329.52epoch/s, loss=3.75e+3, weights_mean=68.5, weights_std=8.63, weights_min=37.6]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.28e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=747, loss_rel_change=-0.417]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=468, loss_rel_change=-0.635]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=295, loss_rel_change=-0.77]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=185, loss_rel_change=-0.855]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=124, loss_rel_change=-0.903]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=80.2, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=52.8, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=36.9, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.5, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.5, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.1, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.8, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.87, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.78, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.54, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.46, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.86, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.17, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.52, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.03, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.865, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.624, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.444, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.505, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.381, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.252, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.256, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.244, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.275, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.219, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.154, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.0839, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0839, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.101, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0749, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.105, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.114, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0572, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0602, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0587, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0423, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.057, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0522, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0611, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0362, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.058, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0249, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0343, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.051, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0477, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0333, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0426, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.046, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0194, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0274, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0212, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0265, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0224, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0411, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0324, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0289, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0181, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0157, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0257, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0228, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0235, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0199, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0139, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.81epoch/s, loss=0.0178, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0178, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0289, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0229, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0203, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0205, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0206, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0313, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.029, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0258, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0209, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0177, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0267, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0205, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0291, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0256, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0203, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0183, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0158, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0308, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0146, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0254, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0243, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.017, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0198, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.00904, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 338.14epoch/s, loss=0.00945, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 342.28epoch/s, loss=0.00945, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.27e+3, weights_mean=73, weights_std=9.03, weights_min=40.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.19e+3, weights_mean=72.3, weights_std=8.94, weights_min=39.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.1e+3, weights_mean=71.6, weights_std=8.85, weights_min=39.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.02e+3, weights_mean=70.9, weights_std=8.76, weights_min=39.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=3.94e+3, weights_mean=70.2, weights_std=8.67, weights_min=38.7]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1418.44epoch/s, loss=3.94e+3, weights_mean=70.2, weights_std=8.67, weights_min=38.7]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.38e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=820, loss_rel_change=-0.407]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=479, loss_rel_change=-0.653]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=313, loss_rel_change=-0.774]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=199, loss_rel_change=-0.856]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=125, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=84.6, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.4, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=44.2, loss_rel_change=-0.968]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.6, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.3, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.9, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.77, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.65, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.88, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.97, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.92, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.38, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.23, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.35, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.11, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.953, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.789, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.674, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.502, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.51, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.383, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.394, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.248, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.196, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.29, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.181, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.196, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=0.174, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.174, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.144, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0904, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0895, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.105, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.103, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0896, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0737, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0732, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0523, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0592, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0566, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0952, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0738, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0506, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0357, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0669, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0771, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0274, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.023, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0482, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0443, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0309, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0323, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0449, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0382, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0333, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0447, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0558, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0292, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0363, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0233, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0534, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 359.88epoch/s, loss=0.0373, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0373, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0387, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.048, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0544, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.029, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0433, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0361, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.024, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0347, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0256, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0478, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0383, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.027, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0309, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0188, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0305, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0236, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0161, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0371, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0454, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0286, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0138, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0414, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0321, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0156, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0405, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0391, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 355.45epoch/s, loss=0.0231, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 346.98epoch/s, loss=0.0231, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.47e+3, weights_mean=74.6, weights_std=9.1, weights_min=43.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.38e+3, weights_mean=73.9, weights_std=9.01, weights_min=43]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.29e+3, weights_mean=73.2, weights_std=8.92, weights_min=42.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.2e+3, weights_mean=72.4, weights_std=8.83, weights_min=42.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.12e+3, weights_mean=71.7, weights_std=8.75, weights_min=41.7]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1391.66epoch/s, loss=4.12e+3, weights_mean=71.7, weights_std=8.75, weights_min=41.7]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.88e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.83e+3, loss_rel_change=-0.365]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.19e+3, loss_rel_change=-0.586]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=772, loss_rel_change=-0.732]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=523, loss_rel_change=-0.819]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=361, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=250, loss_rel_change=-0.913]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=184, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=131, loss_rel_change=-0.955]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=97.6, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=73.7, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=59.3, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=43.6, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=33.6, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.8, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.5, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.8, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.8, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.4, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.27, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.71, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.1, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.64, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.21, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.68, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.13, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.75, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.18, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.07, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.12, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.77, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.32, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.48, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.27, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.82, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.8, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.58, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.47, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.59, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.55, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.33, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.56, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.963, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.987, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.861, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.935, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.96, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.952, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.912, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.978, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.774, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.918, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.836, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.913, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.808, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.825, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.888, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.828, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 352.69epoch/s, loss=0.844, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.844, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.74, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.753, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.768, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.749, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.705, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.784, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.8, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.719, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.702, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.669, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.751, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.851, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.725, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.629, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.753, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.705, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.614, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.681, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.7, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.651, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.672, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.635, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.635, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.582, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.563, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.589, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.701, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.87epoch/s, loss=0.658, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 349.33epoch/s, loss=0.658, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.63e+3, weights_mean=76.1, weights_std=9.15, weights_min=42.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.54e+3, weights_mean=75.4, weights_std=9.06, weights_min=42]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.45e+3, weights_mean=74.6, weights_std=8.97, weights_min=41.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.36e+3, weights_mean=73.9, weights_std=8.88, weights_min=41.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.27e+3, weights_mean=73.2, weights_std=8.79, weights_min=40.8]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1434.65epoch/s, loss=4.27e+3, weights_mean=73.2, weights_std=8.79, weights_min=40.8]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.94e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.87e+3, loss_rel_change=-0.363]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.22e+3, loss_rel_change=-0.585]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=819, loss_rel_change=-0.721]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=531, loss_rel_change=-0.819]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=374, loss_rel_change=-0.873]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=262, loss_rel_change=-0.911]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=188, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=137, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=100, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=76.9, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=58.2, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46.2, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=36.5, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.1, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.9, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.3, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.4, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.8, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.3, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.29, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.85, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.63, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.62, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.44, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.16, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.42, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.06, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.71, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.49, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.96, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.83, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.48, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.3, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=2.3, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=2.09, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.83, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.77, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.75, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.53, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.53, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.49, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.33, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.17, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.88, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.944, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.948, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.956, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.906, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.982, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.869, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 346.79epoch/s, loss=0.839, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.839, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.906, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.919, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.906, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.837, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.864, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.905, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.837, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.784, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.898, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.752, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.816, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.855, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.763, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.749, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.792, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.721, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.711, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.731, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.644, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.86, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.744, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.699, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.715, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.647, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.77, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.677, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.674, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.668, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.7, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.73epoch/s, loss=0.665, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 340.34epoch/s, loss=0.665, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.82e+3, weights_mean=77.5, weights_std=9.18, weights_min=44.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.72e+3, weights_mean=76.7, weights_std=9.09, weights_min=44.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.62e+3, weights_mean=76, weights_std=9, weights_min=43.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.53e+3, weights_mean=75.2, weights_std=8.91, weights_min=43.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.44e+3, weights_mean=74.5, weights_std=8.83, weights_min=42.8]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1426.25epoch/s, loss=4.44e+3, weights_mean=74.5, weights_std=8.83, weights_min=42.8]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.06e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.98e+3, loss_rel_change=-0.354]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.29e+3, loss_rel_change=-0.579]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=858, loss_rel_change=-0.72]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=553, loss_rel_change=-0.819]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=382, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=267, loss_rel_change=-0.913]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=194, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=142, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=103, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=81.1, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=60.8, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.5, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38.7, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.4, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.7, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.4, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.9, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.97, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.06, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.86, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.64, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.17, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.49, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.26, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.91, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.95, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.39, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.88, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.68, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.61, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.39, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=2.39, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=2.17, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=2.26, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.75, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=0.953, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=0.958, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=0.979, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=0.927, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.72epoch/s, loss=0.893, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.893, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.977, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.969, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.902, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.893, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.869, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.889, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.755, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.801, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.833, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.853, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.787, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.848, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.86, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.8, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.751, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.754, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.761, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.827, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.806, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.855, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.744, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.751, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.723, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.717, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.675, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.7, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.68, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.747, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.78epoch/s, loss=0.825, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 341.62epoch/s, loss=0.825, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.99e+3, weights_mean=78.9, weights_std=9.24, weights_min=44.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.89e+3, weights_mean=78.1, weights_std=9.15, weights_min=44.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.79e+3, weights_mean=77.3, weights_std=9.06, weights_min=44.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.7e+3, weights_mean=76.6, weights_std=8.97, weights_min=43.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.6e+3, weights_mean=75.8, weights_std=8.89, weights_min=43.2]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1425.57epoch/s, loss=4.6e+3, weights_mean=75.8, weights_std=8.89, weights_min=43.2]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.62e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.61e+3, loss_rel_change=-0.384]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.01e+3, loss_rel_change=-0.616]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=690, loss_rel_change=-0.737]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=437, loss_rel_change=-0.833]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=306, loss_rel_change=-0.883]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=214, loss_rel_change=-0.918]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=136, loss_rel_change=-0.948]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=104, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74.5, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=59.4, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=43.5, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=32.7, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=24.2, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.6, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.3, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.94, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.13, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.16, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.99, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.33, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.97, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.51, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.83, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.57, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.6, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.26, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.99, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.6, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.58, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.35, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.32, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.984, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.955, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.999, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.871, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.855, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.761, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.821, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.644, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.741, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.571, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.701, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.578, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.668, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.687, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.579, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.582, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.502, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.638, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.418, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.56, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.612, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.479, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.547, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.559, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.594, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.499, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.441, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.508, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.419, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.485, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.45, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.515, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.371, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.54epoch/s, loss=0.552, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.552, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.423, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.525, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.438, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.5, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.49, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.395, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.397, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.387, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.404, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.395, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.471, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.385, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.337, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.355, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.348, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.338, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.391, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.362, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.389, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.322, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.408, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.369, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.402, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.442, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.351, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.351, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.305, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.341, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.439, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.79epoch/s, loss=0.359, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 339.58epoch/s, loss=0.359, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.14e+3, weights_mean=80.2, weights_std=9.22, weights_min=46.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.04e+3, weights_mean=79.4, weights_std=9.13, weights_min=46.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.94e+3, weights_mean=78.6, weights_std=9.04, weights_min=45.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.84e+3, weights_mean=77.8, weights_std=8.95, weights_min=45.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.75e+3, weights_mean=77, weights_std=8.86, weights_min=44.9]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1423.50epoch/s, loss=4.75e+3, weights_mean=77, weights_std=8.86, weights_min=44.9]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.72e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.69e+3, loss_rel_change=-0.377]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.09e+3, loss_rel_change=-0.597]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=673, loss_rel_change=-0.752]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=457, loss_rel_change=-0.832]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=319, loss_rel_change=-0.883]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=215, loss_rel_change=-0.921]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=146, loss_rel_change=-0.946]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=108, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=80.4, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=59.1, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=45.7, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.5, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.1, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.8, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.71, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.15, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.4, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.52, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.3, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.73, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.01, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.11, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.49, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.94, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.7, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.55, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.45, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.93, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.976, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.962, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.919, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.71, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.874, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.815, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.716, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.738, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.776, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.723, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.657, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.595, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.678, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.593, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.611, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.495, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.629, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.596, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.489, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.509, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.569, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.508, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.551, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.481, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.571, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.465, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.485, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.434, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.499, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.56, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.569, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.447, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 355.57epoch/s, loss=0.523, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.523, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.466, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.51, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.482, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.455, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.47, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.409, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.419, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.39, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.435, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.471, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.437, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.557, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.474, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.371, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.403, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.381, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.368, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.424, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.395, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.422, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.494, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.381, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.391, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.367, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.482, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.327, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.386, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 352.94epoch/s, loss=0.402, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 351.35epoch/s, loss=0.402, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.32e+3, weights_mean=81.4, weights_std=9.24, weights_min=46.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.21e+3, weights_mean=80.6, weights_std=9.14, weights_min=46.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.11e+3, weights_mean=79.8, weights_std=9.05, weights_min=45.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.01e+3, weights_mean=79, weights_std=8.96, weights_min=45.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=4.91e+3, weights_mean=78.2, weights_std=8.88, weights_min=44.9]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1400.32epoch/s, loss=4.91e+3, weights_mean=78.2, weights_std=8.88, weights_min=44.9]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.83e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.72e+3, loss_rel_change=-0.392]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.12e+3, loss_rel_change=-0.605]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=741, loss_rel_change=-0.738]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=488, loss_rel_change=-0.827]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=325, loss_rel_change=-0.885]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=212, loss_rel_change=-0.925]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=159, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=109, loss_rel_change=-0.961]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=80.4, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=61.7, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46.9, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=36.2, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.9, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.4, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.04, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.96, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.13, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.58, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.07, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.93, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.14, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.71, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.47, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.95, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.21, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.49, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.64, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.54, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.965, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.884, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.836, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.827, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.922, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.767, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.719, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.752, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.629, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.794, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.709, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.803, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.687, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.709, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.699, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.696, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.601, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.7, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.595, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.561, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.561, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.677, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.542, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.619, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.456, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.538, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.503, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.621, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.482, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.565, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.463, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 354.29epoch/s, loss=0.506, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.506, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.519, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.512, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.484, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.567, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.439, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.511, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.503, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.446, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.414, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.507, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.504, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.464, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.572, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.475, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.387, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.476, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.462, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.35, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.49, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.453, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.432, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.365, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.525, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.384, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.357, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.392, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.402, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 350.93epoch/s, loss=0.463, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 350.05epoch/s, loss=0.463, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.47e+3, weights_mean=82.5, weights_std=9.23, weights_min=50.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.36e+3, weights_mean=81.7, weights_std=9.14, weights_min=50]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.25e+3, weights_mean=80.9, weights_std=9.05, weights_min=49.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.15e+3, weights_mean=80.1, weights_std=8.96, weights_min=49]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.05e+3, weights_mean=79.3, weights_std=8.87, weights_min=48.5]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1415.47epoch/s, loss=5.05e+3, weights_mean=79.3, weights_std=8.87, weights_min=48.5]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.19e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.34e+3, loss_rel_change=-0.387]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=854, loss_rel_change=-0.61]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=544, loss_rel_change=-0.752]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=357, loss_rel_change=-0.837]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=237, loss_rel_change=-0.892]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=162, loss_rel_change=-0.926]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=112, loss_rel_change=-0.949]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=85.4, loss_rel_change=-0.961]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=60, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46.1, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.2, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.6, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.9, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.3, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.77, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.26, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.27, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.6, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.29, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.72, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.96, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.96, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.51, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.39, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.68, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.6, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.61, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.54, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.4, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.26, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.16, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=1.16, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=1.18, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=1.12, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.966, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.877, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.962, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.819, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.868, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.803, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.881, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.797, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.712, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.689, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.729, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.712, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.651, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.684, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.63, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.604, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.593, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.549, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.575, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.61, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.585, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.59, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.531, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.601, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.505, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.579, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.555, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.563, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.555, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.515, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.514, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.492, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.56epoch/s, loss=0.521, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.521, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.504, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.549, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.523, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.504, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.454, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.481, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.538, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.497, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.479, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.468, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.445, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.434, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.453, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.438, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.471, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.474, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.423, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.385, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.412, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.4, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.44, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.408, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.464, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.429, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.403, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.404, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.385, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 349.34epoch/s, loss=0.386, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 348.23epoch/s, loss=0.386, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.62e+3, weights_mean=83.6, weights_std=9.25, weights_min=53.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.5e+3, weights_mean=82.8, weights_std=9.16, weights_min=53.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.39e+3, weights_mean=82, weights_std=9.07, weights_min=52.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.29e+3, weights_mean=81.2, weights_std=8.98, weights_min=52]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.18e+3, weights_mean=80.4, weights_std=8.89, weights_min=51.5]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1397.74epoch/s, loss=5.18e+3, weights_mean=80.4, weights_std=8.89, weights_min=51.5]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.21e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.38e+3, loss_rel_change=-0.374]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=882, loss_rel_change=-0.601]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=562, loss_rel_change=-0.745]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=366, loss_rel_change=-0.834]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=244, loss_rel_change=-0.889]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=167, loss_rel_change=-0.924]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=119, loss_rel_change=-0.946]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=84.5, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=61.8, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.8, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.4, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.5, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.8, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.3, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.39, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.91, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.81, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.69, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.74, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.33, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.79, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.28, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.9, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.29, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.2, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.95, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.83, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.68, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.5, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.53, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.33, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.22, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=1.22, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=1.16, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=1.14, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.977, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.881, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.764, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.863, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.783, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.826, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.803, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.722, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.752, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.743, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.691, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.661, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.642, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.699, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.649, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.611, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.644, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.583, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.615, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.608, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.602, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.627, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.64, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.612, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.578, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.586, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.512, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.585, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.581, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.534, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.571, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.06epoch/s, loss=0.457, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.457, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.548, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.543, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.489, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.451, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.515, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.476, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.497, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.527, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.597, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.494, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.456, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.5, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.445, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.448, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.441, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.42, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.446, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.433, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.441, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.413, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.453, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.47, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.344, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.429, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.432, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.399, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.411, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 351.92epoch/s, loss=0.375, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 351.66epoch/s, loss=0.375, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.77e+3, weights_mean=84.7, weights_std=9.29, weights_min=53.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.65e+3, weights_mean=83.9, weights_std=9.2, weights_min=52.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.54e+3, weights_mean=83, weights_std=9.11, weights_min=52]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.43e+3, weights_mean=82.2, weights_std=9.02, weights_min=51.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.32e+3, weights_mean=81.4, weights_std=8.93, weights_min=51]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1420.45epoch/s, loss=5.32e+3, weights_mean=81.4, weights_std=8.93, weights_min=51]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.28e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.42e+3, loss_rel_change=-0.377]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=879, loss_rel_change=-0.614]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=570, loss_rel_change=-0.75]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=378, loss_rel_change=-0.834]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=250, loss_rel_change=-0.89]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=177, loss_rel_change=-0.922]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=127, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=86.3, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=64.3, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.5, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.9, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.1, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.9, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.28, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.22, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.04, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.55, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.88, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.29, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.88, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.61, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.89, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.68, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.59, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.55, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.38, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.26, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=1.26, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=1.26, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=1.19, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.933, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.914, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.986, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.998, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.909, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.854, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.863, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.761, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.903, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.866, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.767, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.74, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.687, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.737, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.692, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.688, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.747, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.639, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.655, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.668, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.648, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.674, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.612, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.543, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.594, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.58, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.66, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.644, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.567, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.57, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.525, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 356.14epoch/s, loss=0.538, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.538, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.518, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.589, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.573, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.516, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.533, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.525, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.52, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.518, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.569, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.598, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.537, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.544, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.486, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.475, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.519, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.512, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.504, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.44, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.462, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.527, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.475, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.467, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.42, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.477, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.512, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.388, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.445, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 341.49epoch/s, loss=0.472, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 343.22epoch/s, loss=0.472, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.91e+3, weights_mean=85.7, weights_std=9.28, weights_min=54.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.79e+3, weights_mean=84.9, weights_std=9.19, weights_min=53.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.67e+3, weights_mean=84.1, weights_std=9.1, weights_min=53.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.56e+3, weights_mean=83.2, weights_std=9.01, weights_min=52.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.45e+3, weights_mean=82.4, weights_std=8.92, weights_min=52.2]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1403.88epoch/s, loss=5.45e+3, weights_mean=82.4, weights_std=8.92, weights_min=52.2]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.99e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.32e+3, loss_rel_change=-0.334]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.22e+3, loss_rel_change=-0.556]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.52e+3, loss_rel_change=-0.695]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.06e+3, loss_rel_change=-0.787]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=752, loss_rel_change=-0.849]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=550, loss_rel_change=-0.89]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=406, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=307, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=237, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=187, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=149, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=121, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=98.6, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=82.8, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=69.6, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=59.4, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=51.2, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=44.6, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=39.5, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=31.3, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.2, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25.4, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.8, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.4, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.7, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.3, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=12.3, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=11.7, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=11.2, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=10.7, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=10.4, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=9.95, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=9.5, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=9.19, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=9.04, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=8.65, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=8.46, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=8.3, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=7.96, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=7.73, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=7.56, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=7.41, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=7.2, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=6.95, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=6.84, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=6.68, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=6.59, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=6.44, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=6.27, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=6.17, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.97, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.85, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.8, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.68, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.54, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.44, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.36, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.19, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.05, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.01, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=5.06, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 349.75epoch/s, loss=4.9, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.9, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.74, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.74, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.55, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.47, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.55, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.32, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.31, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.26, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.23, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.11, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.11, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.14, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.95, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=4.01, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.85, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.7, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.77, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.73, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.6, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.62, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.56, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.53, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.45, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.34, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.42, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.28, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.25, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.24, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.2, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 348.79epoch/s, loss=3.02, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 343.22epoch/s, loss=3.02, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.04e+3, weights_mean=86.7, weights_std=9.25, weights_min=52.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.92e+3, weights_mean=85.8, weights_std=9.16, weights_min=51.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.8e+3, weights_mean=85, weights_std=9.07, weights_min=51]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.69e+3, weights_mean=84.2, weights_std=8.98, weights_min=50.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.57e+3, weights_mean=83.3, weights_std=8.89, weights_min=50]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1437.33epoch/s, loss=5.57e+3, weights_mean=83.3, weights_std=8.89, weights_min=50]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.14e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.41e+3, loss_rel_change=-0.336]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.28e+3, loss_rel_change=-0.555]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.56e+3, loss_rel_change=-0.695]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.09e+3, loss_rel_change=-0.788]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=768, loss_rel_change=-0.85]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=561, loss_rel_change=-0.891]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=417, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=313, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=243, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=191, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=153, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=125, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=102, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=85.2, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=71.9, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=61.5, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=53.2, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46.4, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=40.6, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=36.2, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=32.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.2, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=24.1, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.6, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.6, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.5, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.6, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.6, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=12.6, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=12.1, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=11.6, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=11.1, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=10.8, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=10.4, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=9.98, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=9.55, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=9.41, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=9.12, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=8.72, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=8.55, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=8.34, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=8.18, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=7.98, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=7.71, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=7.47, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=7.47, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=7.19, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=7.04, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.87, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.87, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.6, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.43, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.17, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.35, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.1, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=6.17, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.84, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.77, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.72, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.54, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.6, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.28, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.32, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.85epoch/s, loss=5.23, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=5.23, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=5.08, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=5, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=5, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.84, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.82, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.71, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.6, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.65, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.46, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.43, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.38, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.23, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.19, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.19, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.17, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.03, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.97, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=4.02, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.89, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.8, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.84, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.66, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.66, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.6, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.57, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.54, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.47, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.43, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.5, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.54epoch/s, loss=3.29, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 337.39epoch/s, loss=3.29, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.17e+3, weights_mean=87.5, weights_std=9.32, weights_min=52.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.05e+3, weights_mean=86.7, weights_std=9.23, weights_min=52.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.93e+3, weights_mean=85.8, weights_std=9.14, weights_min=51.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.81e+3, weights_mean=85, weights_std=9.05, weights_min=51.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.69e+3, weights_mean=84.1, weights_std=8.96, weights_min=50.8]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1396.02epoch/s, loss=5.69e+3, weights_mean=84.1, weights_std=8.96, weights_min=50.8]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.26e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.48e+3, loss_rel_change=-0.339]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.35e+3, loss_rel_change=-0.553]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1591.0, loss_rel_change=-0.698]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.12e+3, loss_rel_change=-0.788]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=797, loss_rel_change=-0.848]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=573, loss_rel_change=-0.891]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=428, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=322, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=250, loss_rel_change=-0.952]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=196, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=157, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=126, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=105, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=86.9, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74.4, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=63.5, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=54.3, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.2, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=42, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=37.2, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=33.3, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.4, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=24.7, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.9, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.9, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.6, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=13, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=12.6, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=11.8, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=11.3, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=11, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=10.7, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=10.3, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=9.94, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=9.63, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=9.34, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=9.05, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=8.8, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=8.52, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=8.31, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=8.12, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=7.89, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=7.82, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=7.61, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=7.17, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=7.2, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=7.14, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=6.93, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=6.68, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=6.58, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=6.52, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=6.43, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=6.2, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=6.06, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.97, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.85, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.73, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.61, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.52, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.5, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.37, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 343.59epoch/s, loss=5.2, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=5.2, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=5.18, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=5.03, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.84, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.95, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.75, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.71, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.63, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.53, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.57, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.45, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.4, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.38, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.33, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.24, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.19, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.02, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=4.02, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.85, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.88, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.77, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.69, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.72, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.59, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.62, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.62, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.53, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.36, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.43, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.85epoch/s, loss=3.33, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 338.22epoch/s, loss=3.33, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.28e+3, weights_mean=88.4, weights_std=9.3, weights_min=56.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.15e+3, weights_mean=87.5, weights_std=9.2, weights_min=55.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.03e+3, weights_mean=86.6, weights_std=9.11, weights_min=55]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.91e+3, weights_mean=85.8, weights_std=9.02, weights_min=54.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.79e+3, weights_mean=84.9, weights_std=8.94, weights_min=53.9]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1412.00epoch/s, loss=5.79e+3, weights_mean=84.9, weights_std=8.94, weights_min=53.9]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.26e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.47e+3, loss_rel_change=-0.341]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.35e+3, loss_rel_change=-0.554]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.6e+3, loss_rel_change=-0.696]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.1e+3, loss_rel_change=-0.791]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=782, loss_rel_change=-0.851]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=566, loss_rel_change=-0.892]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=417, loss_rel_change=-0.921]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=317, loss_rel_change=-0.94]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=242, loss_rel_change=-0.954]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=190, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=152, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=122, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=100, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=84.4, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=70.8, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=60, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=52, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=40.1, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.4, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=31.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.4, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.4, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.997]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=13.5, loss_rel_change=-0.997]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=12.6, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=12.1, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=11.6, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=11, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=10.6, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=10.2, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=9.87, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=9.36, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=9.07, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=8.89, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=8.54, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=8.46, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=8.36, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=8.02, loss_rel_change=-0.998]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=7.75, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=7.63, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=7.61, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=7.35, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=7.27, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.94, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=7.07, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.81, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.57, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.44, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.41, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.25, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.24, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=6.12, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=5.97, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=5.92, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=5.83, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=5.72, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 327.04epoch/s, loss=5.6, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.6, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.6, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.49, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.48, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.45, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.17, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.15, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.12, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.01, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=5.06, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.87, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.82, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.73, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.8, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.79, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.69, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.64, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.5, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.43, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.49, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.39, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.19, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.2, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.1, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.13, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.14, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.17, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=4.02, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=3.95, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=3.88, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=3.92, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=3.9, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=3.81, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=3.67, loss_rel_change=-0.999]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 318.90epoch/s, loss=3.73, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 328.21epoch/s, loss=3.73, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.39e+3, weights_mean=89.2, weights_std=9.36, weights_min=54.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.27e+3, weights_mean=88.3, weights_std=9.27, weights_min=53.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.14e+3, weights_mean=87.4, weights_std=9.17, weights_min=53.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.02e+3, weights_mean=86.5, weights_std=9.08, weights_min=52.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=5.9e+3, weights_mean=85.7, weights_std=9, weights_min=52.3]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1413.05epoch/s, loss=5.9e+3, weights_mean=85.7, weights_std=9, weights_min=52.3]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.31e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.52e+3, loss_rel_change=-0.337]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.36e+3, loss_rel_change=-0.555]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.61e+3, loss_rel_change=-0.696]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.12e+3, loss_rel_change=-0.789]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=796, loss_rel_change=-0.85]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=580, loss_rel_change=-0.891]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=422, loss_rel_change=-0.921]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=324, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=246, loss_rel_change=-0.954]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=194, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=155, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=125, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=103, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=85.9, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=71.8, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=61, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=53.1, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=45.8, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=40.5, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=36.3, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=31.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=24, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.9, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.6, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.4, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.5, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.7, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.1, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.5, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.6, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=11.6, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=11.2, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=10.8, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=10.4, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=10.1, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=9.72, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=9.54, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=9.22, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=8.88, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=8.71, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=8.4, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=8.22, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=8.08, loss_rel_change=-0.998]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=7.91, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=7.74, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=7.52, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=7.38, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=7.2, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=7.08, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=7.09, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.77, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.79, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.64, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.52, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.39, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.35, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.25, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6.13, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=6, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=5.86, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=5.92, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=5.75, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=5.69, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=5.58, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=5.66, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 349.73epoch/s, loss=5.54, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=5.54, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=5.44, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=5.4, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=5.28, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=5.24, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=5.26, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=5.09, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.9, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.9, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.89, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.83, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.89, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.78, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.59, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.69, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.53, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.49, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.42, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.39, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.26, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.33, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.33, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.18, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.05, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.15, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=3.91, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.05, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=4.01, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=3.88, loss_rel_change=-0.999]
Sparse reweighting progress: 71%|███████ | 71/100 [00:00<00:00, 342.57epoch/s, loss=3.88, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 331.50epoch/s, loss=3.88, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.54e+3, weights_mean=90, weights_std=9.4, weights_min=58.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.4e+3, weights_mean=89.1, weights_std=9.3, weights_min=58]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.28e+3, weights_mean=88.2, weights_std=9.21, weights_min=57.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.15e+3, weights_mean=87.4, weights_std=9.12, weights_min=56.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.03e+3, weights_mean=86.5, weights_std=9.03, weights_min=56.3]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1365.95epoch/s, loss=6.03e+3, weights_mean=86.5, weights_std=9.03, weights_min=56.3]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.44e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.62e+3, loss_rel_change=-0.334]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.43e+3, loss_rel_change=-0.553]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.65e+3, loss_rel_change=-0.696]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.15e+3, loss_rel_change=-0.789]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=809, loss_rel_change=-0.851]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=585, loss_rel_change=-0.892]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=435, loss_rel_change=-0.92]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=327, loss_rel_change=-0.94]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=255, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=200, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=158, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=127, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=106, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=87.6, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=62.6, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=54, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.6, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=41.9, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=36.9, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=32.9, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=24.3, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.3, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.8, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.6, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.8, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.3, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.8, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=12.8, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=12, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=11.6, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=11, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=10.8, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=10.3, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=10.2, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=9.74, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=9.2, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=9.15, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=9.02, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=8.53, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=8.57, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=8.27, loss_rel_change=-0.998]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=7.95, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=7.75, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=7.64, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=7.54, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=7.39, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=7.29, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=7.08, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.94, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.96, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.65, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.63, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.52, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.53, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.23, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.33, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.19, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.02, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=6.1, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=5.8, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=5.9, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=5.78, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.32epoch/s, loss=5.62, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.62, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.5, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.58, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.46, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.38, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.27, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.17, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.06, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.04, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=5.02, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.88, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.84, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.71, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.67, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.79, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.6, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.57, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.47, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.43, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.45, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.37, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.31, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.22, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.25, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.21, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.05, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=4.1, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=3.98, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=3.98, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=3.96, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 334.35epoch/s, loss=3.88, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 336.50epoch/s, loss=3.88, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.64e+3, weights_mean=90.8, weights_std=9.38, weights_min=60.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.51e+3, weights_mean=89.9, weights_std=9.29, weights_min=59.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.38e+3, weights_mean=89, weights_std=9.2, weights_min=59.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.25e+3, weights_mean=88.1, weights_std=9.11, weights_min=58.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.13e+3, weights_mean=87.2, weights_std=9.02, weights_min=58.2]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1375.75epoch/s, loss=6.13e+3, weights_mean=87.2, weights_std=9.02, weights_min=58.2]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.06e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.54e+3, loss_rel_change=-0.373]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.68e+3, loss_rel_change=-0.586]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.09e+3, loss_rel_change=-0.73]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=748, loss_rel_change=-0.816]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=482, loss_rel_change=-0.881]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=362, loss_rel_change=-0.911]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=248, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=179, loss_rel_change=-0.956]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=136, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=102, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=79.8, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=60.9, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=49.3, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38.4, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=32.1, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.3, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.7, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.4, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.36, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.79, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.76, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.65, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.07, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.59, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.18, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.42, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.99, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=3.99, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=3.7, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=3.66, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=3.27, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=3.16, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.92, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=3.02, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.64, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.63, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.42, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.53, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.57, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.32, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.2, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=2.18, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.99, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.86, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.85, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.9, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.89, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.89, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.85, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.7, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.71, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.85, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.77, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.78, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 326.59epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.63, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.33, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.23, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 308.90epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 98%|█████████▊| 98/100 [00:00<00:00, 310.29epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 98%|█████████▊| 98/100 [00:00<00:00, 310.29epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 98%|█████████▊| 98/100 [00:00<00:00, 310.29epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 310.23epoch/s, loss=1.11, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.74e+3, weights_mean=91.5, weights_std=9.45, weights_min=60.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.61e+3, weights_mean=90.6, weights_std=9.35, weights_min=59.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.48e+3, weights_mean=89.7, weights_std=9.26, weights_min=59.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.35e+3, weights_mean=88.9, weights_std=9.17, weights_min=58.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.22e+3, weights_mean=88, weights_std=9.08, weights_min=58.1]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1415.52epoch/s, loss=6.22e+3, weights_mean=88, weights_std=9.08, weights_min=58.1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.1e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.61e+3, loss_rel_change=-0.363]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.68e+3, loss_rel_change=-0.589]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.12e+3, loss_rel_change=-0.725]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=741, loss_rel_change=-0.819]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=517, loss_rel_change=-0.874]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=346, loss_rel_change=-0.916]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=249, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=188, loss_rel_change=-0.954]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=134, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=102, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=78.4, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=63, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=50.4, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=40.3, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=31.8, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.5, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.5, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.5, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.6, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.74, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.15, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.38, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.83, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.23, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.47, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.92, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.36, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.29, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.36, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=3.36, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=3.15, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=3.26, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=3.02, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.74, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.77, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.61, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.38, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.4, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.44, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.27, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.97, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.04, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.96, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.9, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.94, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=2.01, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.86, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.79, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.78, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.65, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.63, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.81, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.65, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 350.35epoch/s, loss=1.69, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.69, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.54, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 336.22epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 331.24epoch/s, loss=1.28, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.87e+3, weights_mean=92.2, weights_std=9.42, weights_min=58.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.73e+3, weights_mean=91.3, weights_std=9.33, weights_min=57.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.6e+3, weights_mean=90.4, weights_std=9.23, weights_min=57.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.46e+3, weights_mean=89.5, weights_std=9.14, weights_min=56.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.34e+3, weights_mean=88.6, weights_std=9.05, weights_min=56.1]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1372.24epoch/s, loss=6.34e+3, weights_mean=88.6, weights_std=9.05, weights_min=56.1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.26e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.72e+3, loss_rel_change=-0.362]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.71e+3, loss_rel_change=-0.599]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.13e+3, loss_rel_change=-0.734]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=759, loss_rel_change=-0.822]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=522, loss_rel_change=-0.878]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=365, loss_rel_change=-0.914]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=258, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=187, loss_rel_change=-0.956]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=142, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=110, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=82.4, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=63.5, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=50.9, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=41.3, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=33, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.1, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.1, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.9, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.4, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.84, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.51, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.79, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.16, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.5, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.73, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.32, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.19, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.35, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.27, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=4.27, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=3.92, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=3.95, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=3.36, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=3.35, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=3.36, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=3.08, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=3.11, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.95, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.54, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.67, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.45, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.39, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.22, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.35, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.05, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.05, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=2.16, loss_rel_change=-0.999]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.94, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.83, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.99, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.71, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.87, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.9, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.84, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.86, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.78, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.91, loss_rel_change=-1]
Sparse reweighting progress: 33%|███▎ | 33/100 [00:00<00:00, 329.32epoch/s, loss=1.73, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.73, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.7, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.71, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.7, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.78, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.32, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 66%|██████▌ | 66/100 [00:00<00:00, 322.70epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 99%|█████████▉| 99/100 [00:00<00:00, 325.94epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 99%|█████████▉| 99/100 [00:00<00:00, 325.94epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 322.99epoch/s, loss=1.24, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.95e+3, weights_mean=92.8, weights_std=9.37, weights_min=61.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.81e+3, weights_mean=91.9, weights_std=9.27, weights_min=61.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.68e+3, weights_mean=91, weights_std=9.18, weights_min=60.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.55e+3, weights_mean=90.1, weights_std=9.09, weights_min=60.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.42e+3, weights_mean=89.2, weights_std=9, weights_min=59.5]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1305.15epoch/s, loss=6.42e+3, weights_mean=89.2, weights_std=9, weights_min=59.5]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.39e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.78e+3, loss_rel_change=-0.367]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.82e+3, loss_rel_change=-0.586]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.18e+3, loss_rel_change=-0.732]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=799, loss_rel_change=-0.818]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=542, loss_rel_change=-0.877]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=388, loss_rel_change=-0.911]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=285, loss_rel_change=-0.935]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=206, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=151, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=118, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=92.6, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=73.4, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.8, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46.1, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38.1, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=32.2, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.8, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.6, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.8, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.87, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.63, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.25, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.42, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.91, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.32, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=6.32, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=5.85, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=5.54, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=5.22, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=5.07, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=4.8, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=4.63, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=4.38, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=4.02, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=4.02, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.73, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.46, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.46, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.36, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.19, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.25, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.15, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.13, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.11, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=3.06, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.91, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.91, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.77, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.69, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.67, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.75, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.6, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.6, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.54, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.55, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 31%|███ | 31/100 [00:00<00:00, 303.85epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.45, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.54, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.48, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.23, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.2, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.18, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.21, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.42, loss_rel_change=-0.999]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.13, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.06, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.09, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.01, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.97, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.98, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.12, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.98, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.99, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.04, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.01, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.08, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=2.06, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.73, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.86, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.93, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.86, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.85, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 63/100 [00:00<00:00, 311.81epoch/s, loss=1.89, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 305.89epoch/s, loss=1.89, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 305.89epoch/s, loss=1.85, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 305.89epoch/s, loss=1.91, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 305.89epoch/s, loss=1.81, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 305.89epoch/s, loss=1.87, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 305.89epoch/s, loss=1.8, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 304.78epoch/s, loss=1.8, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.04e+3, weights_mean=93.4, weights_std=9.42, weights_min=61.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.9e+3, weights_mean=92.5, weights_std=9.32, weights_min=60.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.76e+3, weights_mean=91.6, weights_std=9.23, weights_min=60.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.63e+3, weights_mean=90.7, weights_std=9.14, weights_min=59.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.5e+3, weights_mean=89.8, weights_std=9.05, weights_min=59.1]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1247.42epoch/s, loss=6.5e+3, weights_mean=89.8, weights_std=9.05, weights_min=59.1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.42e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.81e+3, loss_rel_change=-0.363]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.82e+3, loss_rel_change=-0.588]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.21e+3, loss_rel_change=-0.725]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=821, loss_rel_change=-0.814]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=555, loss_rel_change=-0.874]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=397, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=283, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=205, loss_rel_change=-0.954]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=153, loss_rel_change=-0.965]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=120, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=91, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=73.5, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=57.5, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=45.8, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=37.6, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=31.4, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.9, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.3, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.8, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.8, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.67, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.58, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.25, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.56, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.86, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.64, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.94, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.8, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.01, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=5.01, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=5.05, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=5.03, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=4.66, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=4.09, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=4.18, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=4.09, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.96, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.39, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.67, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.39, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.37, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.33, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.25, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.17, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.01, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.04, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.05, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=3.01, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.91, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.82, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.76, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.58, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.62, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.62, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.52, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.5, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.38, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.35, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.31, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.4, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.46epoch/s, loss=2.46, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.46, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.29, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.28, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.28, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.27, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.22, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.2, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.24, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.15, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.1, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.07, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.11, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.04, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.17, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.14, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.96, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.04, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.97, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.96, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.83, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.97, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.88, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.95, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.88, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.88, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.78, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 337.17epoch/s, loss=1.74, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 336.91epoch/s, loss=1.74, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.15e+3, weights_mean=94, weights_std=9.46, weights_min=62.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.01e+3, weights_mean=93.1, weights_std=9.37, weights_min=61.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.87e+3, weights_mean=92.2, weights_std=9.28, weights_min=61]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.73e+3, weights_mean=91.3, weights_std=9.19, weights_min=60.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.6e+3, weights_mean=90.4, weights_std=9.1, weights_min=59.8]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1428.79epoch/s, loss=6.6e+3, weights_mean=90.4, weights_std=9.1, weights_min=59.8]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.5e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.89e+3, loss_rel_change=-0.358]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.88e+3, loss_rel_change=-0.582]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.22e+3, loss_rel_change=-0.728]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=824, loss_rel_change=-0.817]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=577, loss_rel_change=-0.872]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=400, loss_rel_change=-0.911]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=276, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=211, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=160, loss_rel_change=-0.965]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=119, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=93.6, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=75.6, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.6, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=48.3, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=39.6, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=32.7, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.2, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=23.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.6, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.8, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.87, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.42, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.44, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.35, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.27, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.89, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.69, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.46, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=5.46, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=4.95, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=4.82, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=4.61, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=4.23, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=4.32, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=4, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.85, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.64, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.55, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.43, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.53, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.57, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.25, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.09, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.01, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.95, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.08, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=3.09, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.85, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.78, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.71, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.82, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.71, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.7, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.59, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.4, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.52, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.51, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.32, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.54, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.64, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 338.42epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.49, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.42, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.62, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.35, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.4, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.26, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.29, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.14, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.11, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.14, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.22, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.15, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.95, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.92, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.9, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.87, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.97, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.9, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.93, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.89, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.9, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.87, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.40epoch/s, loss=1.91, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 327.44epoch/s, loss=1.91, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.22e+3, weights_mean=94.6, weights_std=9.42, weights_min=60.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.08e+3, weights_mean=93.6, weights_std=9.33, weights_min=59.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.94e+3, weights_mean=92.7, weights_std=9.23, weights_min=59.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.8e+3, weights_mean=91.8, weights_std=9.14, weights_min=58.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.67e+3, weights_mean=90.9, weights_std=9.05, weights_min=57.9]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1369.76epoch/s, loss=6.67e+3, weights_mean=90.9, weights_std=9.05, weights_min=57.9]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.41e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.1e+3, loss_rel_change=-0.383]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.32e+3, loss_rel_change=-0.614]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=867, loss_rel_change=-0.745]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=564, loss_rel_change=-0.835]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=375, loss_rel_change=-0.89]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=263, loss_rel_change=-0.923]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=194, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=136, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=104, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=78.4, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=58.8, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=45.8, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38.9, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=30, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25.1, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.8, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.78, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.73, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.66, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.91, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.35, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.57, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.15, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.09, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.31, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.95, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.02, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.81, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.41, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.33, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.12, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=3.12, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=3.13, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=3.04, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.68, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.7, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.42, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.41, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.27, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.19, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.2, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.22, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.21, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.11, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.09, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.05, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.99, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=2.04, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.87, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.95, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.82, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.89, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.87, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.88, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.79, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.8, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.66, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.71, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.75, loss_rel_change=-0.999]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.69, loss_rel_change=-1]
Sparse reweighting progress: 36%|███▌ | 36/100 [00:00<00:00, 351.49epoch/s, loss=1.75, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.75, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.69, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.75, loss_rel_change=-0.999]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.66, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.56, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.54, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 72%|███████▏ | 72/100 [00:00<00:00, 348.16epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 346.31epoch/s, loss=1.39, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.3e+3, weights_mean=95.1, weights_std=9.5, weights_min=61.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.15e+3, weights_mean=94.2, weights_std=9.4, weights_min=60.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.01e+3, weights_mean=93.2, weights_std=9.31, weights_min=60.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.87e+3, weights_mean=92.3, weights_std=9.22, weights_min=59.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.74e+3, weights_mean=91.4, weights_std=9.13, weights_min=59]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1382.62epoch/s, loss=6.74e+3, weights_mean=91.4, weights_std=9.13, weights_min=59]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.36e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.1e+3, loss_rel_change=-0.375]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.33e+3, loss_rel_change=-0.605]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=870, loss_rel_change=-0.741]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=573, loss_rel_change=-0.83]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=385, loss_rel_change=-0.885]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=273, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=195, loss_rel_change=-0.942]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=140, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=102, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=78.1, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=60.9, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.2, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.5, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=24.6, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.8, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.2, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.8, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.61, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.28, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.59, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.7, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.21, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.63, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.05, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.88, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.48, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.76, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.7, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.18, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.19, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=3.19, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=3.17, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.88, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.71, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.62, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.54, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.46, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.29, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.32, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.16, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.21, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.05, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.94, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.95, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=2.01, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.95, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.91, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.99, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.8, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.77, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.7, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.7, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 344.52epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.49, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 341.03epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 341.21epoch/s, loss=1.31, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.41e+3, weights_mean=95.6, weights_std=9.55, weights_min=65.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.26e+3, weights_mean=94.7, weights_std=9.46, weights_min=64.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.11e+3, weights_mean=93.8, weights_std=9.37, weights_min=63.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.97e+3, weights_mean=92.8, weights_std=9.27, weights_min=63.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.83e+3, weights_mean=91.9, weights_std=9.18, weights_min=62.7]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1417.96epoch/s, loss=6.83e+3, weights_mean=91.9, weights_std=9.18, weights_min=62.7]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.44e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.16e+3, loss_rel_change=-0.371]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.36e+3, loss_rel_change=-0.603]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=881, loss_rel_change=-0.744]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=576, loss_rel_change=-0.832]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=400, loss_rel_change=-0.884]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=276, loss_rel_change=-0.92]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=193, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=141, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=107, loss_rel_change=-0.969]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=79, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=61, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=48.2, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38.1, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.8, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=24.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.2, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.9, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.9, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.59, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.35, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.66, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.56, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.77, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.68, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.04, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.86, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.31, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.05, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.53, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.39, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=3.39, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=3.23, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=3.19, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.87, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.71, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.71, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.68, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.59, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.35, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.38, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.38, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.23, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.11, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.01, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.06, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.03, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.02, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.98, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.93, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.97, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.92, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.89, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.94, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.83, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.8, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.7, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.71, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.7, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 347.39epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.63, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.69, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.49, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.49, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 337.85epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 338.43epoch/s, loss=1.39, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.49e+3, weights_mean=96.2, weights_std=9.56, weights_min=65.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.34e+3, weights_mean=95.2, weights_std=9.47, weights_min=65.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.19e+3, weights_mean=94.3, weights_std=9.37, weights_min=64.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.05e+3, weights_mean=93.3, weights_std=9.28, weights_min=63.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.91e+3, weights_mean=92.4, weights_std=9.19, weights_min=63.2]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1383.28epoch/s, loss=6.91e+3, weights_mean=92.4, weights_std=9.19, weights_min=63.2]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.18e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.97e+3, loss_rel_change=-0.378]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.25e+3, loss_rel_change=-0.605]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=822, loss_rel_change=-0.741]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=537, loss_rel_change=-0.831]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=365, loss_rel_change=-0.885]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=252, loss_rel_change=-0.921]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=180, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=133, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=96.1, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=75, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.9, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46.8, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.6, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.4, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.2, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.4, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.6, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.8, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.3, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.31, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.83, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.94, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.27, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.91, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.14, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.14, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.62, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.14, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.59, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.43, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.14, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=3.14, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.96, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.87, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.84, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.5, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.42, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.14, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.12, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.14, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.94, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.16, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2.02, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.98, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.98, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=2, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.93, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.71, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.67, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.63, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.56, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.63, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 335.45epoch/s, loss=1.6, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.6, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.63, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.49, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.49, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.32, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 333.54epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 332.81epoch/s, loss=1.34, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.55e+3, weights_mean=96.7, weights_std=9.49, weights_min=66]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.4e+3, weights_mean=95.7, weights_std=9.39, weights_min=65.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.25e+3, weights_mean=94.8, weights_std=9.3, weights_min=64.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.11e+3, weights_mean=93.8, weights_std=9.21, weights_min=64]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=6.97e+3, weights_mean=92.9, weights_std=9.12, weights_min=63.4]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1421.63epoch/s, loss=6.97e+3, weights_mean=92.9, weights_std=9.12, weights_min=63.4]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.24e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.01e+3, loss_rel_change=-0.381]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.28e+3, loss_rel_change=-0.605]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=821, loss_rel_change=-0.747]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=550, loss_rel_change=-0.83]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=370, loss_rel_change=-0.886]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=253, loss_rel_change=-0.922]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=185, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=127, loss_rel_change=-0.961]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=98.1, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74.3, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.9, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=44.7, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.4, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.3, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.6, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.2, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.6, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.32, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.81, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.34, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.68, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.8, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.54, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.76, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.45, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.32, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.07, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.61, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.53, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.41, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.34, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=3.34, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=3.13, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.76, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.91, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.64, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.48, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.4, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.35, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.1, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.03, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.09, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.1, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=2.05, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.98, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.99, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.94, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.92, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.84, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.71, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.71, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.72, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.72, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.72, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.65, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.91epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.32, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 335.01epoch/s, loss=1.33, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 333.99epoch/s, loss=1.33, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.64e+3, weights_mean=97.2, weights_std=9.51, weights_min=64.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.49e+3, weights_mean=96.2, weights_std=9.41, weights_min=63.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.34e+3, weights_mean=95.2, weights_std=9.32, weights_min=62.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.19e+3, weights_mean=94.3, weights_std=9.23, weights_min=62.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.05e+3, weights_mean=93.4, weights_std=9.14, weights_min=61.7]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1363.62epoch/s, loss=7.05e+3, weights_mean=93.4, weights_std=9.14, weights_min=61.7]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.25e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.07e+3, loss_rel_change=-0.364]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.31e+3, loss_rel_change=-0.597]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=846, loss_rel_change=-0.74]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=549, loss_rel_change=-0.831]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=373, loss_rel_change=-0.885]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=253, loss_rel_change=-0.922]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=183, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=131, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=101, loss_rel_change=-0.969]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=75.4, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.8, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=45, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.5, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=29.8, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25.5, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=19, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.7, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.2, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.5, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.29, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.1, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.15, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.56, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.89, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.15, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.95, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.66, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.91, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.83, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.55, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.45, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=3.45, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=3.21, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=3.13, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.82, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.61, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.45, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.45, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.38, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.44, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.22, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.18, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.21, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.17, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.23, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.9, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.97, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.9, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.87, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.8, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.84, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.8, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.68, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.7, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.63, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 336.58epoch/s, loss=1.67, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.67, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.65, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.64, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.71, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.56, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.65, loss_rel_change=-0.999]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.54, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.54, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.32, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.56, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 334.36epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 332.54epoch/s, loss=1.39, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.7e+3, weights_mean=97.5, weights_std=9.49, weights_min=64.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.54e+3, weights_mean=96.6, weights_std=9.39, weights_min=64]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.39e+3, weights_mean=95.6, weights_std=9.3, weights_min=63.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.25e+3, weights_mean=94.7, weights_std=9.21, weights_min=62.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.1e+3, weights_mean=93.7, weights_std=9.12, weights_min=62.1]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1390.73epoch/s, loss=7.1e+3, weights_mean=93.7, weights_std=9.12, weights_min=62.1]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.78e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.71e+3, loss_rel_change=-0.384]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.08e+3, loss_rel_change=-0.612]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=699, loss_rel_change=-0.748]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=446, loss_rel_change=-0.839]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=296, loss_rel_change=-0.893]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=201, loss_rel_change=-0.928]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=141, loss_rel_change=-0.949]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=99.3, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=72.7, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=54.8, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=43.5, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.2, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.7, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.6, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.1, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.86, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.88, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.44, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.49, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.11, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.24, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.68, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.87, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.64, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.48, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.16, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.05, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.38, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.16, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=2.16, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=2.12, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.87, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.67, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.7, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.57, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.52, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.47, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.41, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.47, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.32, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.32, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.51epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=0.964, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=0.994, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=0.973, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 331.17epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 330.15epoch/s, loss=1.02, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.76e+3, weights_mean=97.9, weights_std=9.53, weights_min=67]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.6e+3, weights_mean=97, weights_std=9.44, weights_min=66.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.45e+3, weights_mean=96, weights_std=9.34, weights_min=65.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.3e+3, weights_mean=95.1, weights_std=9.25, weights_min=65]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.16e+3, weights_mean=94.1, weights_std=9.16, weights_min=64.4]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1406.53epoch/s, loss=7.16e+3, weights_mean=94.1, weights_std=9.16, weights_min=64.4]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.87e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.76e+3, loss_rel_change=-0.386]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.1e+3, loss_rel_change=-0.619]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=687, loss_rel_change=-0.761]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=446, loss_rel_change=-0.845]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=300, loss_rel_change=-0.895]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=206, loss_rel_change=-0.928]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=142, loss_rel_change=-0.95]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=100, loss_rel_change=-0.965]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=77.3, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=57.9, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=42.7, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.6, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.9, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.3, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.2, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.4, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.4, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.53, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.59, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.97, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.57, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.59, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.93, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.99, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.47, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.32, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.84, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.88, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.55, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=2.26, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=2.13, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=2.14, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.97, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.85, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.72, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.5, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.59, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.58, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.54, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.53, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.53, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.49, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.33, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.33, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.23, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.17, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.95epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.23, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.17, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 332.11epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 331.63epoch/s, loss=1.09, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.82e+3, weights_mean=98.3, weights_std=9.6, weights_min=66.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.66e+3, weights_mean=97.3, weights_std=9.5, weights_min=65.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.51e+3, weights_mean=96.3, weights_std=9.41, weights_min=65.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.36e+3, weights_mean=95.4, weights_std=9.31, weights_min=64.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.21e+3, weights_mean=94.4, weights_std=9.22, weights_min=63.9]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1413.01epoch/s, loss=7.21e+3, weights_mean=94.4, weights_std=9.22, weights_min=63.9]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.82e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.77e+3, loss_rel_change=-0.374]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.09e+3, loss_rel_change=-0.612]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=722, loss_rel_change=-0.744]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=460, loss_rel_change=-0.837]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=295, loss_rel_change=-0.895]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=211, loss_rel_change=-0.925]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=142, loss_rel_change=-0.95]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=106, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=78.4, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=56.1, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=42.6, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.4, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.8, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.4, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.2, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.64, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.86, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.55, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.87, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.19, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.36, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.31, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.51, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.45, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.42, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.93, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.99, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.48, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.26, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=2.26, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=2, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.88, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.96, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.79, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.72, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.75, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.64, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.59, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.58, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.68, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.48, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.53, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.47, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.23, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.23, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.41epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=0.952, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 326.15epoch/s, loss=0.932, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 330.04epoch/s, loss=0.932, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.87e+3, weights_mean=98.6, weights_std=9.64, weights_min=66.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.72e+3, weights_mean=97.6, weights_std=9.54, weights_min=65.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.56e+3, weights_mean=96.7, weights_std=9.45, weights_min=64.7]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.41e+3, weights_mean=95.7, weights_std=9.36, weights_min=64.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.27e+3, weights_mean=94.8, weights_std=9.26, weights_min=63.5]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1389.15epoch/s, loss=7.27e+3, weights_mean=94.8, weights_std=9.26, weights_min=63.5]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.34e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.74e+3, loss_rel_change=-0.37]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.74e+3, loss_rel_change=-0.6]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.12e+3, loss_rel_change=-0.743]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=756, loss_rel_change=-0.826]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=525, loss_rel_change=-0.879]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=366, loss_rel_change=-0.916]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=254, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=188, loss_rel_change=-0.957]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=129, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=104, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=77.9, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=59.5, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=46, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=40, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=28.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.3, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=15.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.8, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.4, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.14, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.39, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.35, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.96, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.95, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.56, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.77, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.28, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.92, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.67, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=3.67, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=3.72, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=3.5, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=3.18, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=3.05, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.9, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.67, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.39, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.52, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.44, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.54, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.28, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.43, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.16, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.22, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=2.1, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.98, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.99, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.73, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.78, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.88, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.82, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.98, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.65, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.84, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.85, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.95, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.77, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.66, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.63, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 334.88epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.75, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.56, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.49, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.32, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.45, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 335.76epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 336.59epoch/s, loss=1.27, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.91e+3, weights_mean=98.9, weights_std=9.61, weights_min=67.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.75e+3, weights_mean=98, weights_std=9.51, weights_min=66.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.6e+3, weights_mean=97, weights_std=9.42, weights_min=65.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.45e+3, weights_mean=96, weights_std=9.32, weights_min=65.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.3e+3, weights_mean=95.1, weights_std=9.23, weights_min=64.6]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1364.70epoch/s, loss=7.3e+3, weights_mean=95.1, weights_std=9.23, weights_min=64.6]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.37e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.7e+3, loss_rel_change=-0.38]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.75e+3, loss_rel_change=-0.599]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.15e+3, loss_rel_change=-0.737]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=754, loss_rel_change=-0.827]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=503, loss_rel_change=-0.885]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=354, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=250, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=183, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=135, loss_rel_change=-0.969]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=104, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=75.7, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=61.9, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.9, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=39.6, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=30.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25.8, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.4, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.3, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.2, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.9, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.92, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.56, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.11, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.28, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.6, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.95, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.83, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.11, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.74, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.46, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.4, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.74, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.8, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=3.8, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=3.51, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=3.2, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=3.25, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.91, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.74, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.75, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.6, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.76, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.5, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.38, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.39, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.03, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.22, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.17, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.09, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.09, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.06, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=2.03, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.88, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.99, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.94, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.86, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.94, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.6, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.93, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.95, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.73, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.65, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.82, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.85, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.59, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 340.82epoch/s, loss=1.81, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.81, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.73, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.7, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.63, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.56, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.5, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.55, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.58, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.63, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.56, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.44, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.4, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.23, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 332.38epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 331.45epoch/s, loss=1.2, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.98e+3, weights_mean=99.3, weights_std=9.6, weights_min=68.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.82e+3, weights_mean=98.3, weights_std=9.5, weights_min=68.3]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.66e+3, weights_mean=97.3, weights_std=9.41, weights_min=67.6]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.51e+3, weights_mean=96.3, weights_std=9.31, weights_min=66.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.36e+3, weights_mean=95.4, weights_std=9.22, weights_min=66.3]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1402.46epoch/s, loss=7.36e+3, weights_mean=95.4, weights_std=9.22, weights_min=66.3]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.4e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.77e+3, loss_rel_change=-0.371]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.77e+3, loss_rel_change=-0.598]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.12e+3, loss_rel_change=-0.746]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=779, loss_rel_change=-0.823]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=514, loss_rel_change=-0.883]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=357, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=258, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=190, loss_rel_change=-0.957]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=135, loss_rel_change=-0.969]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=101, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=80.7, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=62.6, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=47.7, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=38.3, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=31.9, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.2, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=22.5, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=16.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.7, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.8, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=10.8, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.75, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.17, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.7, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.19, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.25, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.66, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.73, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.34, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.25, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=3.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=3.82, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=3.7, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=3.01, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=3.08, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.99, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.77, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.88, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.55, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.65, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.72, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.49, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.56, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.49, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.32, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.3, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.21, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.11, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.2, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.95, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.06, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.96, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.88, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.96, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.81, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.92, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=2.02, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.77, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.71, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.71, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.75, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.64, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.71, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.04epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.67, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.78, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.82, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.73, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.57, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.81, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.74, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.66, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.68, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.62, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.53, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.61, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.51, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.47, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.52, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.48, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.54, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.46, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.3, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.34, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 319.61epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 319.29epoch/s, loss=1.38, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 319.08epoch/s, loss=1.38, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=8.02e+3, weights_mean=99.5, weights_std=9.58, weights_min=69.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.86e+3, weights_mean=98.5, weights_std=9.49, weights_min=68.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.7e+3, weights_mean=97.6, weights_std=9.39, weights_min=67.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.55e+3, weights_mean=96.6, weights_std=9.3, weights_min=67.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.4e+3, weights_mean=95.6, weights_std=9.21, weights_min=66.4]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1243.17epoch/s, loss=7.4e+3, weights_mean=95.6, weights_std=9.21, weights_min=66.4]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.86e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.74e+3, loss_rel_change=-0.39]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.11e+3, loss_rel_change=-0.612]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=679, loss_rel_change=-0.762]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=442, loss_rel_change=-0.845]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=300, loss_rel_change=-0.895]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=210, loss_rel_change=-0.927]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=148, loss_rel_change=-0.948]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=105, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=78.3, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=59.2, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=43.3, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=33.3, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=25.6, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=18.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=14.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=12.6, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.74, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.68, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.33, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.49, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.42, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.05, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.23, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.96, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.16, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.05, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.63, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=2.27, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=2.12, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.93, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.92, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.86, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.7, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.64, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.49, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.62, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.49, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.37, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.39, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.23, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 32%|███▏ | 32/100 [00:00<00:00, 319.98epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.97, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.965, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.902, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.964, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.969, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.916, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.897, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.936, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.986, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.923, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.963, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.881, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.867, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.971, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.885, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.916, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.926, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.933, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.845, loss_rel_change=-1]
Sparse reweighting progress: 64%|██████▍ | 64/100 [00:00<00:00, 307.55epoch/s, loss=0.937, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 303.67epoch/s, loss=0.937, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 303.67epoch/s, loss=0.776, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 303.67epoch/s, loss=0.851, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 303.67epoch/s, loss=0.887, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 303.67epoch/s, loss=0.81, loss_rel_change=-1]
Sparse reweighting progress: 95%|█████████▌| 95/100 [00:00<00:00, 303.67epoch/s, loss=0.891, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 305.48epoch/s, loss=0.891, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=8.03e+3, weights_mean=99.8, weights_std=9.59, weights_min=66.4]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.87e+3, weights_mean=98.8, weights_std=9.5, weights_min=65.8]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.71e+3, weights_mean=97.8, weights_std=9.4, weights_min=65.1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.56e+3, weights_mean=96.8, weights_std=9.31, weights_min=64.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.41e+3, weights_mean=95.9, weights_std=9.22, weights_min=63.8]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1363.50epoch/s, loss=7.41e+3, weights_mean=95.9, weights_std=9.22, weights_min=63.8]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.89e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.73e+3, loss_rel_change=-0.402]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.12e+3, loss_rel_change=-0.611]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=670, loss_rel_change=-0.768]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=442, loss_rel_change=-0.847]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=315, loss_rel_change=-0.891]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=205, loss_rel_change=-0.929]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=145, loss_rel_change=-0.95]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=106, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=74.8, loss_rel_change=-0.974]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=58.4, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=44.5, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=34.9, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=27.1, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=20.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.7, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.6, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.53, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.84, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.41, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.02, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.51, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.14, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.45, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.03, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.69, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.29, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.01, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.66, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.63, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.28, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=2.03, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.94, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.95, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.78, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.55, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.66, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.52, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.41, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.47, loss_rel_change=-0.999]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.43, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.29, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.08, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.2, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.21, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=0.974, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 34%|███▍ | 34/100 [00:00<00:00, 333.38epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.966, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.977, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.933, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.99, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.953, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.973, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.862, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.991, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.931, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.962, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.967, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.942, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.882, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.907, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.913, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.926, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.968, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.923, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.856, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.949, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.858, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.829, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.852, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.917, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.911, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.776, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.918, loss_rel_change=-1]
Sparse reweighting progress: 68%|██████▊ | 68/100 [00:00<00:00, 328.41epoch/s, loss=0.814, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 320.85epoch/s, loss=0.814, loss_rel_change=-1]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=8.1e+3, weights_mean=100, weights_std=9.62, weights_min=67.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.94e+3, weights_mean=99.1, weights_std=9.52, weights_min=67.2]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.78e+3, weights_mean=98.1, weights_std=9.43, weights_min=66.5]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.63e+3, weights_mean=97.1, weights_std=9.34, weights_min=65.9]
Reweighting progress: 0%| | 0/50 [00:00<?, ?epoch/s, loss=7.48e+3, weights_mean=96.2, weights_std=9.25, weights_min=65.2]
Reweighting progress: 100%|██████████| 50/50 [00:00<00:00, 1390.54epoch/s, loss=7.48e+3, weights_mean=96.2, weights_std=9.25, weights_min=65.2]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.86e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.79e+3, loss_rel_change=-0.376]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.1e+3, loss_rel_change=-0.616]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=702, loss_rel_change=-0.755]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=454, loss_rel_change=-0.841]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=305, loss_rel_change=-0.894]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=206, loss_rel_change=-0.928]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=145, loss_rel_change=-0.949]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=107, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=77.5, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=58.7, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=44.6, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=35.3, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=26.8, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=21.5, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=17.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=11.7, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=9.77, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=8.21, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=7.43, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=6.6, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.77, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=5.14, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=4.4, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.84, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.63, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=3.53, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.96, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.81, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.57, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.52, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.24, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=2.01, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/100 [00:00<?, ?epoch/s, loss=1.9, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.9, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.93, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.85, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.89, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.58, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.62, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.55, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.42, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.45, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.51, loss_rel_change=-0.999]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.35, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.36, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.31, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.26, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.22, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.19, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=0.996, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=0.933, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=0.98, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=0.971, loss_rel_change=-1]
Sparse reweighting progress: 35%|███▌ | 35/100 [00:00<00:00, 341.75epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.997, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.954, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.957, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.939, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.948, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.997, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.935, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.98, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.973, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.955, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.97, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.911, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.974, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.899, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.878, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.904, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.835, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.869, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.917, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.917, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.834, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.86, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.957, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.868, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.878, loss_rel_change=-1]
Sparse reweighting progress: 70%|███████ | 70/100 [00:00<00:00, 338.47epoch/s, loss=0.814, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 100/100 [00:00<00:00, 337.47epoch/s, loss=0.814, loss_rel_change=-1]
==================================================
Tuning completed!
==================================================
Analyzing tuning results¶
# Display best parameters
print("Best parameters found:")
print(f" l0_lambda: {best_params['l0_lambda']:.2e}")
print(f" init_mean: {best_params['init_mean']:.4f}")
print(f" temperature: {best_params['temperature']:.2f}")
print()
print("Performance metrics:")
print(f" Mean validation loss: {best_params['mean_val_loss']:.6f} (±{best_params['std_val_loss']:.6f})")
print(f" Mean validation accuracy: {best_params['mean_val_accuracy']:.1%} (±{best_params['std_val_accuracy']:.1%})")
print(f" Sparsity achieved: {best_params['sparsity']:.1%}")
print()
print("Cross-validation results:")
print(f" Holdout objectives: {best_params['holdout_objectives']}")
print(f" Number of holdout sets: {best_params['n_holdout_sets']}")
print(f" Aggregation method: {best_params['aggregation']}")
Best parameters found:
l0_lambda: 7.43e-05
init_mean: 0.8443
temperature: 1.79
Performance metrics:
Mean validation loss: 0.002145 (±0.000429)
Mean validation accuracy: 100.0% (±0.0%)
Sparsity achieved: 0.0%
Cross-validation results:
Holdout objectives: [np.float64(9.999662306138315), np.float64(10.002067335881293), np.float64(9.998705360995606)]
Number of holdout sets: 3
Aggregation method: mean
Applying the best parameters¶
Now let’s apply the best parameters found through tuning and compare with default parameters.
# Calibration with tuned parameters
cal_tuned = Calibration(
weights=weights_init.copy(),
targets=targets,
estimate_matrix=estimate_matrix,
epochs=200,
learning_rate=1e-3,
regularize_with_l0=True,
l0_lambda=best_params['l0_lambda'],
init_mean=best_params['init_mean'],
temperature=best_params['temperature'],
)
print("Calibrating with tuned parameters...")
perf_tuned = cal_tuned.calibrate()
weights_tuned = cal_tuned.sparse_weights
# Calibration with default parameters
cal_default = Calibration(
weights=weights_init.copy(),
targets=targets,
estimate_matrix=estimate_matrix,
epochs=200,
learning_rate=1e-3,
regularize_with_l0=True,
l0_lambda=5e-6, # Default
init_mean=0.999, # Default
temperature=0.5, # Default
)
print("Calibrating with default parameters...")
perf_default = cal_default.calibrate()
weights_default = cal_default.sparse_weights
print("\nComparison complete!")
Calibrating with tuned parameters...
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.8, weights_mean=5.98, weights_std=2.87, weights_min=1]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.4, weights_mean=5.92, weights_std=2.84, weights_min=0.99]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.9, weights_mean=5.86, weights_std=2.81, weights_min=0.98]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.4, weights_mean=5.81, weights_std=2.79, weights_min=0.971]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18, weights_mean=5.75, weights_std=2.76, weights_min=0.961]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.6, weights_mean=5.69, weights_std=2.73, weights_min=0.952]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.2, weights_mean=5.64, weights_std=2.71, weights_min=0.943]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.8, weights_mean=5.59, weights_std=2.68, weights_min=0.934]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.4, weights_mean=5.53, weights_std=2.66, weights_min=0.925]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16, weights_mean=5.48, weights_std=2.63, weights_min=0.917]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.6, weights_mean=5.43, weights_std=2.61, weights_min=0.908]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.3, weights_mean=5.38, weights_std=2.58, weights_min=0.9]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.9, weights_mean=5.34, weights_std=2.56, weights_min=0.892]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.6, weights_mean=5.29, weights_std=2.54, weights_min=0.884]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.3, weights_mean=5.24, weights_std=2.52, weights_min=0.876]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14, weights_mean=5.2, weights_std=2.49, weights_min=0.869]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=13.7, weights_mean=5.15, weights_std=2.47, weights_min=0.861]
Reweighting progress: 80%|████████ | 161/200 [00:00<00:00, 1598.17epoch/s, loss=13.7, weights_mean=5.15, weights_std=2.47, weights_min=0.861]
Reweighting progress: 80%|████████ | 161/200 [00:00<00:00, 1598.17epoch/s, loss=13.4, weights_mean=5.11, weights_std=2.45, weights_min=0.854]
Reweighting progress: 80%|████████ | 161/200 [00:00<00:00, 1598.17epoch/s, loss=13.1, weights_mean=5.06, weights_std=2.43, weights_min=0.847]
Reweighting progress: 80%|████████ | 161/200 [00:00<00:00, 1598.17epoch/s, loss=12.8, weights_mean=5.02, weights_std=2.41, weights_min=0.84]
Reweighting progress: 100%|██████████| 200/200 [00:00<00:00, 1617.74epoch/s, loss=12.8, weights_mean=5.02, weights_std=2.41, weights_min=0.84]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.488, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.4, loss_rel_change=-0.18]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.372, loss_rel_change=-0.238]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.406, loss_rel_change=-0.168]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.42, loss_rel_change=-0.14]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.39, loss_rel_change=-0.2]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.236]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.237]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.382, loss_rel_change=-0.217]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.392, loss_rel_change=-0.196]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.392, loss_rel_change=-0.197]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.387, loss_rel_change=-0.206]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.379, loss_rel_change=-0.223]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.372, loss_rel_change=-0.237]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.239]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.377, loss_rel_change=-0.228]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.38, loss_rel_change=-0.221]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.381, loss_rel_change=-0.218]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.376, loss_rel_change=-0.229]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.372, loss_rel_change=-0.238]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.239]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.236]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.375, loss_rel_change=-0.232]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.376, loss_rel_change=-0.229]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.375, loss_rel_change=-0.232]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.236]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.372, loss_rel_change=-0.238]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.24]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.372, loss_rel_change=-0.238]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.236]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.235]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.236]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.24]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.24]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.24]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.239]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.37, loss_rel_change=-0.242]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.37, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.369, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.369, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.369, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.369, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.369, loss_rel_change=-0.245]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.368, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.368, loss_rel_change=-0.247]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.367, loss_rel_change=-0.247]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.367, loss_rel_change=-0.249]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.367, loss_rel_change=-0.249]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.366, loss_rel_change=-0.251]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.365, loss_rel_change=-0.252]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.365, loss_rel_change=-0.252]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.364, loss_rel_change=-0.253]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.363, loss_rel_change=-0.255]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.363, loss_rel_change=-0.256]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.362, loss_rel_change=-0.258]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.362, loss_rel_change=-0.259]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.362, loss_rel_change=-0.259]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.361, loss_rel_change=-0.26]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.36, loss_rel_change=-0.261]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.36, loss_rel_change=-0.263]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.359, loss_rel_change=-0.265]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.358, loss_rel_change=-0.267]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.358, loss_rel_change=-0.267]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.357, loss_rel_change=-0.269]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.356, loss_rel_change=-0.271]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.355, loss_rel_change=-0.273]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.354, loss_rel_change=-0.274]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.353, loss_rel_change=-0.276]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.352, loss_rel_change=-0.278]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.351, loss_rel_change=-0.28]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.35, loss_rel_change=-0.282]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.35, loss_rel_change=-0.284]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.349, loss_rel_change=-0.286]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.348, loss_rel_change=-0.288]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.347, loss_rel_change=-0.289]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.346, loss_rel_change=-0.292]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.345, loss_rel_change=-0.294]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.344, loss_rel_change=-0.296]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.343, loss_rel_change=-0.297]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.342, loss_rel_change=-0.3]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.341, loss_rel_change=-0.302]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.34, loss_rel_change=-0.304]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.339, loss_rel_change=-0.305]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.338, loss_rel_change=-0.307]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.337, loss_rel_change=-0.308]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.336, loss_rel_change=-0.311]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.335, loss_rel_change=-0.313]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.335, loss_rel_change=-0.314]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.334, loss_rel_change=-0.316]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.333, loss_rel_change=-0.318]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.332, loss_rel_change=-0.32]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.331, loss_rel_change=-0.322]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.33, loss_rel_change=-0.324]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.329, loss_rel_change=-0.326]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.328, loss_rel_change=-0.327]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.327, loss_rel_change=-0.329]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.326, loss_rel_change=-0.331]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.325, loss_rel_change=-0.333]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.324, loss_rel_change=-0.335]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.324, loss_rel_change=-0.336]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.323, loss_rel_change=-0.339]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.321, loss_rel_change=-0.342]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.32, loss_rel_change=-0.343]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.319, loss_rel_change=-0.345]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.319, loss_rel_change=-0.347]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.318, loss_rel_change=-0.349]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.317, loss_rel_change=-0.351]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.316, loss_rel_change=-0.353]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.315, loss_rel_change=-0.354]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.314, loss_rel_change=-0.356]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.313, loss_rel_change=-0.358]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.313, loss_rel_change=-0.359]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.312, loss_rel_change=-0.361]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.311, loss_rel_change=-0.363]
Sparse reweighting progress: 14%|█▍ | 58/400 [00:00<00:00, 571.12epoch/s, loss=0.31, loss_rel_change=-0.364]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.31, loss_rel_change=-0.364]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.309, loss_rel_change=-0.367]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.308, loss_rel_change=-0.368]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.307, loss_rel_change=-0.371]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.306, loss_rel_change=-0.372]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.305, loss_rel_change=-0.374]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.305, loss_rel_change=-0.376]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.304, loss_rel_change=-0.378]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.303, loss_rel_change=-0.379]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.302, loss_rel_change=-0.381]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.301, loss_rel_change=-0.382]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.301, loss_rel_change=-0.384]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.3, loss_rel_change=-0.386]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.299, loss_rel_change=-0.388]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.298, loss_rel_change=-0.39]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.297, loss_rel_change=-0.391]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.296, loss_rel_change=-0.393]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.295, loss_rel_change=-0.396]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.294, loss_rel_change=-0.397]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.293, loss_rel_change=-0.399]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.292, loss_rel_change=-0.401]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.292, loss_rel_change=-0.402]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.29, loss_rel_change=-0.405]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.289, loss_rel_change=-0.408]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.288, loss_rel_change=-0.409]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.288, loss_rel_change=-0.41]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.287, loss_rel_change=-0.413]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.286, loss_rel_change=-0.415]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.285, loss_rel_change=-0.416]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.284, loss_rel_change=-0.418]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.283, loss_rel_change=-0.42]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.283, loss_rel_change=-0.421]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.281, loss_rel_change=-0.424]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.281, loss_rel_change=-0.425]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.279, loss_rel_change=-0.427]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.279, loss_rel_change=-0.429]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.278, loss_rel_change=-0.431]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.276, loss_rel_change=-0.434]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.275, loss_rel_change=-0.436]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.274, loss_rel_change=-0.438]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.274, loss_rel_change=-0.439]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.272, loss_rel_change=-0.442]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.271, loss_rel_change=-0.444]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.271, loss_rel_change=-0.444]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.27, loss_rel_change=-0.447]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.268, loss_rel_change=-0.45]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.268, loss_rel_change=-0.452]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.267, loss_rel_change=-0.453]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.266, loss_rel_change=-0.455]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.265, loss_rel_change=-0.458]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.264, loss_rel_change=-0.459]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.263, loss_rel_change=-0.462]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.262, loss_rel_change=-0.464]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.261, loss_rel_change=-0.466]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.26, loss_rel_change=-0.468]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.259, loss_rel_change=-0.47]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.257, loss_rel_change=-0.473]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.256, loss_rel_change=-0.475]
Sparse reweighting progress: 29%|██▉ | 116/400 [00:00<00:00, 570.05epoch/s, loss=0.255, loss_rel_change=-0.477]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.255, loss_rel_change=-0.477]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.254, loss_rel_change=-0.479]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.253, loss_rel_change=-0.481]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.252, loss_rel_change=-0.483]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.251, loss_rel_change=-0.485]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.251, loss_rel_change=-0.487]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.249, loss_rel_change=-0.489]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.249, loss_rel_change=-0.49]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.247, loss_rel_change=-0.493]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.246, loss_rel_change=-0.496]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.246, loss_rel_change=-0.497]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.244, loss_rel_change=-0.499]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.243, loss_rel_change=-0.502]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.242, loss_rel_change=-0.504]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.241, loss_rel_change=-0.506]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.24, loss_rel_change=-0.508]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.239, loss_rel_change=-0.509]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.238, loss_rel_change=-0.512]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.237, loss_rel_change=-0.515]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.236, loss_rel_change=-0.517]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.235, loss_rel_change=-0.519]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.233, loss_rel_change=-0.522]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.233, loss_rel_change=-0.523]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.231, loss_rel_change=-0.526]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.23, loss_rel_change=-0.529]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.229, loss_rel_change=-0.531]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.228, loss_rel_change=-0.533]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.227, loss_rel_change=-0.534]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.226, loss_rel_change=-0.538]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.225, loss_rel_change=-0.54]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.224, loss_rel_change=-0.541]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.222, loss_rel_change=-0.545]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.221, loss_rel_change=-0.547]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.22, loss_rel_change=-0.549]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.219, loss_rel_change=-0.552]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.217, loss_rel_change=-0.555]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.216, loss_rel_change=-0.558]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.215, loss_rel_change=-0.56]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.213, loss_rel_change=-0.563]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.212, loss_rel_change=-0.565]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.211, loss_rel_change=-0.568]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.21, loss_rel_change=-0.57]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.209, loss_rel_change=-0.572]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.207, loss_rel_change=-0.576]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.206, loss_rel_change=-0.579]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.205, loss_rel_change=-0.581]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.204, loss_rel_change=-0.583]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.202, loss_rel_change=-0.585]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.202, loss_rel_change=-0.587]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.201, loss_rel_change=-0.588]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.199, loss_rel_change=-0.591]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.198, loss_rel_change=-0.594]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.197, loss_rel_change=-0.596]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.197, loss_rel_change=-0.597]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.193, loss_rel_change=-0.604]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.195, loss_rel_change=-0.601]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.192, loss_rel_change=-0.606]
Sparse reweighting progress: 44%|████▎ | 174/400 [00:00<00:00, 565.95epoch/s, loss=0.19, loss_rel_change=-0.611]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.19, loss_rel_change=-0.611]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.19, loss_rel_change=-0.61]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.189, loss_rel_change=-0.614]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.187, loss_rel_change=-0.617]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.186, loss_rel_change=-0.619]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.188, loss_rel_change=-0.615]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.183, loss_rel_change=-0.626]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.182, loss_rel_change=-0.626]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.183, loss_rel_change=-0.626]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.18, loss_rel_change=-0.63]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.179, loss_rel_change=-0.634]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.181, loss_rel_change=-0.63]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.18, loss_rel_change=-0.631]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.177, loss_rel_change=-0.638]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.179, loss_rel_change=-0.633]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.178, loss_rel_change=-0.636]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.173, loss_rel_change=-0.645]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.177, loss_rel_change=-0.638]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.172, loss_rel_change=-0.648]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.17, loss_rel_change=-0.651]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.171, loss_rel_change=-0.651]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.169, loss_rel_change=-0.654]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.168, loss_rel_change=-0.657]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.167, loss_rel_change=-0.657]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.168, loss_rel_change=-0.657]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.166, loss_rel_change=-0.661]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.166, loss_rel_change=-0.66]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.166, loss_rel_change=-0.66]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.164, loss_rel_change=-0.665]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.163, loss_rel_change=-0.667]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.163, loss_rel_change=-0.666]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.162, loss_rel_change=-0.667]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.162, loss_rel_change=-0.668]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.16, loss_rel_change=-0.672]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.163, loss_rel_change=-0.666]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.161, loss_rel_change=-0.669]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.158, loss_rel_change=-0.677]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.163, loss_rel_change=-0.666]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.158, loss_rel_change=-0.676]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.156, loss_rel_change=-0.681]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.156, loss_rel_change=-0.681]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.156, loss_rel_change=-0.68]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.155, loss_rel_change=-0.683]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.154, loss_rel_change=-0.685]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.157, loss_rel_change=-0.678]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.152, loss_rel_change=-0.688]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.152, loss_rel_change=-0.688]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.154, loss_rel_change=-0.684]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.152, loss_rel_change=-0.688]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.152, loss_rel_change=-0.688]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.149, loss_rel_change=-0.694]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.15, loss_rel_change=-0.693]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.148, loss_rel_change=-0.696]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.149, loss_rel_change=-0.695]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.146, loss_rel_change=-0.7]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.146, loss_rel_change=-0.7]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.144, loss_rel_change=-0.704]
Sparse reweighting progress: 58%|█████▊ | 231/400 [00:00<00:00, 563.77epoch/s, loss=0.144, loss_rel_change=-0.705]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.144, loss_rel_change=-0.705]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.145, loss_rel_change=-0.703]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.143, loss_rel_change=-0.708]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.143, loss_rel_change=-0.707]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.143, loss_rel_change=-0.708]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.142, loss_rel_change=-0.71]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.141, loss_rel_change=-0.712]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.142, loss_rel_change=-0.708]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.141, loss_rel_change=-0.712]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.142, loss_rel_change=-0.709]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.14, loss_rel_change=-0.713]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.139, loss_rel_change=-0.715]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.139, loss_rel_change=-0.714]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.139, loss_rel_change=-0.714]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.139, loss_rel_change=-0.715]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.138, loss_rel_change=-0.717]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.137, loss_rel_change=-0.719]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.136, loss_rel_change=-0.721]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.137, loss_rel_change=-0.718]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.134, loss_rel_change=-0.726]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.134, loss_rel_change=-0.726]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.134, loss_rel_change=-0.725]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.132, loss_rel_change=-0.729]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.134, loss_rel_change=-0.725]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.131, loss_rel_change=-0.731]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.131, loss_rel_change=-0.732]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.131, loss_rel_change=-0.732]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.131, loss_rel_change=-0.732]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.129, loss_rel_change=-0.735]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.13, loss_rel_change=-0.733]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.129, loss_rel_change=-0.735]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.129, loss_rel_change=-0.735]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.128, loss_rel_change=-0.737]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.129, loss_rel_change=-0.735]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.127, loss_rel_change=-0.739]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.127, loss_rel_change=-0.74]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.128, loss_rel_change=-0.739]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.127, loss_rel_change=-0.74]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.126, loss_rel_change=-0.741]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.126, loss_rel_change=-0.741]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.126, loss_rel_change=-0.742]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.125, loss_rel_change=-0.743]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.126, loss_rel_change=-0.742]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.126, loss_rel_change=-0.742]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.125, loss_rel_change=-0.743]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.124, loss_rel_change=-0.747]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.125, loss_rel_change=-0.744]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.124, loss_rel_change=-0.746]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.122, loss_rel_change=-0.75]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.125, loss_rel_change=-0.743]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.124, loss_rel_change=-0.747]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.122, loss_rel_change=-0.75]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.124, loss_rel_change=-0.746]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.122, loss_rel_change=-0.749]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.121, loss_rel_change=-0.753]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.12, loss_rel_change=-0.754]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.12, loss_rel_change=-0.754]
Sparse reweighting progress: 72%|███████▏ | 288/400 [00:00<00:00, 559.67epoch/s, loss=0.124, loss_rel_change=-0.747]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.124, loss_rel_change=-0.747]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.12, loss_rel_change=-0.754]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.122, loss_rel_change=-0.75]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.12, loss_rel_change=-0.754]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.118, loss_rel_change=-0.758]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.118, loss_rel_change=-0.758]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.119, loss_rel_change=-0.757]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.117, loss_rel_change=-0.761]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.118, loss_rel_change=-0.759]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.117, loss_rel_change=-0.761]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.116, loss_rel_change=-0.763]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.117, loss_rel_change=-0.761]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.116, loss_rel_change=-0.762]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.115, loss_rel_change=-0.764]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.116, loss_rel_change=-0.762]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.115, loss_rel_change=-0.764]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.114, loss_rel_change=-0.766]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.115, loss_rel_change=-0.764]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.114, loss_rel_change=-0.766]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.113, loss_rel_change=-0.768]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.114, loss_rel_change=-0.766]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.113, loss_rel_change=-0.769]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.114, loss_rel_change=-0.767]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.113, loss_rel_change=-0.768]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.112, loss_rel_change=-0.771]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.112, loss_rel_change=-0.771]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.115, loss_rel_change=-0.764]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.112, loss_rel_change=-0.771]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.112, loss_rel_change=-0.771]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.112, loss_rel_change=-0.771]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.111, loss_rel_change=-0.772]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.111, loss_rel_change=-0.772]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.11, loss_rel_change=-0.775]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.112, loss_rel_change=-0.77]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.111, loss_rel_change=-0.772]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.109, loss_rel_change=-0.776]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.11, loss_rel_change=-0.775]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.111, loss_rel_change=-0.773]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.109, loss_rel_change=-0.776]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.109, loss_rel_change=-0.776]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.109, loss_rel_change=-0.777]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.108, loss_rel_change=-0.779]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.11, loss_rel_change=-0.775]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.108, loss_rel_change=-0.778]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.108, loss_rel_change=-0.779]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.108, loss_rel_change=-0.779]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.107, loss_rel_change=-0.78]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.108, loss_rel_change=-0.779]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.107, loss_rel_change=-0.782]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.108, loss_rel_change=-0.78]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.107, loss_rel_change=-0.781]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.106, loss_rel_change=-0.783]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.106, loss_rel_change=-0.782]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.105, loss_rel_change=-0.784]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.105, loss_rel_change=-0.784]
Sparse reweighting progress: 86%|████████▋ | 345/400 [00:00<00:00, 562.88epoch/s, loss=0.105, loss_rel_change=-0.786]
Sparse reweighting progress: 100%|██████████| 400/400 [00:00<00:00, 566.21epoch/s, loss=0.105, loss_rel_change=-0.786]
Calibrating with default parameters...
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=20.3, weights_mean=6.06, weights_std=2.89, weights_min=1]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.8, weights_mean=6, weights_std=2.86, weights_min=0.993]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=19.3, weights_mean=5.94, weights_std=2.84, weights_min=0.983]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.8, weights_mean=5.88, weights_std=2.81, weights_min=0.973]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=18.4, weights_mean=5.82, weights_std=2.78, weights_min=0.964]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.9, weights_mean=5.77, weights_std=2.75, weights_min=0.954]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.5, weights_mean=5.71, weights_std=2.73, weights_min=0.945]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=17.1, weights_mean=5.66, weights_std=2.7, weights_min=0.936]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.7, weights_mean=5.61, weights_std=2.68, weights_min=0.928]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16.3, weights_mean=5.55, weights_std=2.65, weights_min=0.919]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=16, weights_mean=5.5, weights_std=2.63, weights_min=0.911]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.6, weights_mean=5.45, weights_std=2.6, weights_min=0.902]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=15.3, weights_mean=5.4, weights_std=2.58, weights_min=0.894]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.9, weights_mean=5.36, weights_std=2.56, weights_min=0.886]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.6, weights_mean=5.31, weights_std=2.53, weights_min=0.879]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14.3, weights_mean=5.26, weights_std=2.51, weights_min=0.871]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=14, weights_mean=5.22, weights_std=2.49, weights_min=0.863]
Reweighting progress: 0%| | 0/200 [00:00<?, ?epoch/s, loss=13.7, weights_mean=5.17, weights_std=2.47, weights_min=0.856]
Reweighting progress: 86%|████████▌ | 171/200 [00:00<00:00, 1703.54epoch/s, loss=13.7, weights_mean=5.17, weights_std=2.47, weights_min=0.856]
Reweighting progress: 86%|████████▌ | 171/200 [00:00<00:00, 1703.54epoch/s, loss=13.4, weights_mean=5.13, weights_std=2.45, weights_min=0.849]
Reweighting progress: 86%|████████▌ | 171/200 [00:00<00:00, 1703.54epoch/s, loss=13.1, weights_mean=5.09, weights_std=2.43, weights_min=0.842]
Reweighting progress: 100%|██████████| 200/200 [00:00<00:00, 1710.29epoch/s, loss=13.1, weights_mean=5.09, weights_std=2.43, weights_min=0.842]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0332, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.037, loss_rel_change=0.116]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0282, loss_rel_change=-0.149]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0257, loss_rel_change=-0.225]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0303, loss_rel_change=-0.0876]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0297, loss_rel_change=-0.104]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0259, loss_rel_change=-0.219]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0254, loss_rel_change=-0.236]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0279, loss_rel_change=-0.161]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.028, loss_rel_change=-0.157]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0258, loss_rel_change=-0.223]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0264, loss_rel_change=-0.204]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0271, loss_rel_change=-0.184]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0262, loss_rel_change=-0.211]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0253, loss_rel_change=-0.237]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0262, loss_rel_change=-0.209]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0261, loss_rel_change=-0.213]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0256, loss_rel_change=-0.23]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0258, loss_rel_change=-0.221]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0254, loss_rel_change=-0.234]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.247]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0255, loss_rel_change=-0.232]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0253, loss_rel_change=-0.238]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.245]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.239]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.241]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.245]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.247]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.24]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.244]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0252, loss_rel_change=-0.242]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.243]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0251, loss_rel_change=-0.245]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.248]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.249]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.25]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.025, loss_rel_change=-0.246]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.25]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0249, loss_rel_change=-0.251]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 0%| | 0/400 [00:00<?, ?epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0248, loss_rel_change=-0.252]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0248, loss_rel_change=-0.254]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0249, loss_rel_change=-0.251]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0246, loss_rel_change=-0.258]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0247, loss_rel_change=-0.255]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0246, loss_rel_change=-0.26]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0244, loss_rel_change=-0.265]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0244, loss_rel_change=-0.265]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0243, loss_rel_change=-0.267]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.024, loss_rel_change=-0.276]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.024, loss_rel_change=-0.277]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0238, loss_rel_change=-0.284]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0234, loss_rel_change=-0.295]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0235, loss_rel_change=-0.292]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0232, loss_rel_change=-0.301]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.023, loss_rel_change=-0.308]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0226, loss_rel_change=-0.32]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0221, loss_rel_change=-0.334]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0218, loss_rel_change=-0.343]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0216, loss_rel_change=-0.349]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0213, loss_rel_change=-0.359]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.021, loss_rel_change=-0.368]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0214, loss_rel_change=-0.355]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0203, loss_rel_change=-0.389]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0202, loss_rel_change=-0.393]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0202, loss_rel_change=-0.391]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.02, loss_rel_change=-0.399]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0196, loss_rel_change=-0.411]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0193, loss_rel_change=-0.418]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0195, loss_rel_change=-0.412]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0191, loss_rel_change=-0.424]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0189, loss_rel_change=-0.43]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0196, loss_rel_change=-0.409]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0192, loss_rel_change=-0.42]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0187, loss_rel_change=-0.436]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0192, loss_rel_change=-0.422]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0187, loss_rel_change=-0.436]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0183, loss_rel_change=-0.449]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0183, loss_rel_change=-0.449]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0185, loss_rel_change=-0.443]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0184, loss_rel_change=-0.446]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.018, loss_rel_change=-0.457]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0181, loss_rel_change=-0.454]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0178, loss_rel_change=-0.463]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0175, loss_rel_change=-0.473]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.018, loss_rel_change=-0.458]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0185, loss_rel_change=-0.443]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0171, loss_rel_change=-0.485]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.018, loss_rel_change=-0.457]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0182, loss_rel_change=-0.453]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0167, loss_rel_change=-0.497]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0173, loss_rel_change=-0.477]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0182, loss_rel_change=-0.452]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0171, loss_rel_change=-0.484]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.017, loss_rel_change=-0.488]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0173, loss_rel_change=-0.48]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0165, loss_rel_change=-0.502]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0161, loss_rel_change=-0.514]
Sparse reweighting progress: 15%|█▍ | 59/400 [00:00<00:00, 589.71epoch/s, loss=0.0165, loss_rel_change=-0.502]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0165, loss_rel_change=-0.502]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0169, loss_rel_change=-0.49]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0159, loss_rel_change=-0.52]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.016, loss_rel_change=-0.517]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0163, loss_rel_change=-0.508]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.016, loss_rel_change=-0.517]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0159, loss_rel_change=-0.522]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0161, loss_rel_change=-0.516]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0161, loss_rel_change=-0.514]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0156, loss_rel_change=-0.53]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.016, loss_rel_change=-0.518]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0158, loss_rel_change=-0.525]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0156, loss_rel_change=-0.53]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0159, loss_rel_change=-0.52]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0155, loss_rel_change=-0.534]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0159, loss_rel_change=-0.522]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0151, loss_rel_change=-0.545]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0151, loss_rel_change=-0.544]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0154, loss_rel_change=-0.537]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.015, loss_rel_change=-0.548]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0149, loss_rel_change=-0.551]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0149, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0147, loss_rel_change=-0.556]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0151, loss_rel_change=-0.544]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0147, loss_rel_change=-0.557]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0148, loss_rel_change=-0.556]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0164, loss_rel_change=-0.507]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0164, loss_rel_change=-0.507]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0147, loss_rel_change=-0.556]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0154, loss_rel_change=-0.535]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.015, loss_rel_change=-0.547]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0151, loss_rel_change=-0.546]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0152, loss_rel_change=-0.542]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0146, loss_rel_change=-0.561]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.015, loss_rel_change=-0.549]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0157, loss_rel_change=-0.528]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0155, loss_rel_change=-0.534]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0145, loss_rel_change=-0.562]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0147, loss_rel_change=-0.557]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0149, loss_rel_change=-0.551]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0152, loss_rel_change=-0.541]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.015, loss_rel_change=-0.548]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.015, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0149, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0144, loss_rel_change=-0.565]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0143, loss_rel_change=-0.568]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0148, loss_rel_change=-0.553]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0141, loss_rel_change=-0.575]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.014, loss_rel_change=-0.577]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0149, loss_rel_change=-0.55]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0136, loss_rel_change=-0.59]
Sparse reweighting progress: 30%|██▉ | 118/400 [00:00<00:00, 570.85epoch/s, loss=0.0161, loss_rel_change=-0.515]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0161, loss_rel_change=-0.515]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.015, loss_rel_change=-0.548]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0136, loss_rel_change=-0.589]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.014, loss_rel_change=-0.577]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0139, loss_rel_change=-0.582]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0144, loss_rel_change=-0.566]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0137, loss_rel_change=-0.587]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.014, loss_rel_change=-0.578]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0133, loss_rel_change=-0.599]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0148, loss_rel_change=-0.555]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0135, loss_rel_change=-0.594]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0133, loss_rel_change=-0.6]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0147, loss_rel_change=-0.557]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0139, loss_rel_change=-0.583]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0141, loss_rel_change=-0.576]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0149, loss_rel_change=-0.552]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0142, loss_rel_change=-0.572]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0144, loss_rel_change=-0.567]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0152, loss_rel_change=-0.542]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0144, loss_rel_change=-0.567]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0146, loss_rel_change=-0.56]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0132, loss_rel_change=-0.603]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0142, loss_rel_change=-0.571]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0148, loss_rel_change=-0.556]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0133, loss_rel_change=-0.6]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.014, loss_rel_change=-0.578]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.013, loss_rel_change=-0.61]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0132, loss_rel_change=-0.603]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0135, loss_rel_change=-0.593]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0135, loss_rel_change=-0.593]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.013, loss_rel_change=-0.608]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0145, loss_rel_change=-0.563]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0133, loss_rel_change=-0.599]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0145, loss_rel_change=-0.564]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0127, loss_rel_change=-0.617]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0138, loss_rel_change=-0.585]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0138, loss_rel_change=-0.584]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0126, loss_rel_change=-0.62]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0142, loss_rel_change=-0.573]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0135, loss_rel_change=-0.593]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0126, loss_rel_change=-0.62]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0136, loss_rel_change=-0.591]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0131, loss_rel_change=-0.604]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0131, loss_rel_change=-0.607]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0123, loss_rel_change=-0.63]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0124, loss_rel_change=-0.627]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0127, loss_rel_change=-0.618]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0126, loss_rel_change=-0.622]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0134, loss_rel_change=-0.597]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0127, loss_rel_change=-0.619]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0126, loss_rel_change=-0.62]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0125, loss_rel_change=-0.623]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0128, loss_rel_change=-0.615]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0126, loss_rel_change=-0.621]
Sparse reweighting progress: 44%|████▍ | 176/400 [00:00<00:00, 566.94epoch/s, loss=0.0123, loss_rel_change=-0.629]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0123, loss_rel_change=-0.629]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0124, loss_rel_change=-0.626]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0124, loss_rel_change=-0.627]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0122, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0124, loss_rel_change=-0.626]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0125, loss_rel_change=-0.622]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0122, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0123, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0124, loss_rel_change=-0.625]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.637]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0121, loss_rel_change=-0.636]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0125, loss_rel_change=-0.622]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0124, loss_rel_change=-0.628]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0122, loss_rel_change=-0.632]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0122, loss_rel_change=-0.632]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.639]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.646]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.646]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0119, loss_rel_change=-0.642]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0121, loss_rel_change=-0.636]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0119, loss_rel_change=-0.642]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.639]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.645]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0123, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0119, loss_rel_change=-0.64]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0124, loss_rel_change=-0.626]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0124, loss_rel_change=-0.627]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.637]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0114, loss_rel_change=-0.657]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0123, loss_rel_change=-0.628]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.645]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0123, loss_rel_change=-0.631]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0119, loss_rel_change=-0.643]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0114, loss_rel_change=-0.655]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0116, loss_rel_change=-0.652]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0113, loss_rel_change=-0.659]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.639]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0116, loss_rel_change=-0.652]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0126, loss_rel_change=-0.622]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0118, loss_rel_change=-0.646]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.648]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0117, loss_rel_change=-0.646]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.012, loss_rel_change=-0.638]
Sparse reweighting progress: 59%|█████▉ | 236/400 [00:00<00:00, 576.49epoch/s, loss=0.0114, loss_rel_change=-0.657]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0114, loss_rel_change=-0.657]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0115, loss_rel_change=-0.655]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0114, loss_rel_change=-0.656]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0118, loss_rel_change=-0.643]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0121, loss_rel_change=-0.635]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0118, loss_rel_change=-0.644]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0114, loss_rel_change=-0.656]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0115, loss_rel_change=-0.653]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0116, loss_rel_change=-0.652]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.666]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.011, loss_rel_change=-0.667]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0116, loss_rel_change=-0.65]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0112, loss_rel_change=-0.664]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0113, loss_rel_change=-0.66]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0113, loss_rel_change=-0.66]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.011, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.667]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0114, loss_rel_change=-0.657]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.011, loss_rel_change=-0.669]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.665]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.665]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.664]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0109, loss_rel_change=-0.671]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0117, loss_rel_change=-0.647]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0109, loss_rel_change=-0.672]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.667]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0113, loss_rel_change=-0.659]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0109, loss_rel_change=-0.673]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.011, loss_rel_change=-0.669]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.675]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.676]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.666]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0111, loss_rel_change=-0.666]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0112, loss_rel_change=-0.662]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0109, loss_rel_change=-0.671]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0112, loss_rel_change=-0.664]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0106, loss_rel_change=-0.68]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.011, loss_rel_change=-0.67]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.675]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0107, loss_rel_change=-0.679]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0106, loss_rel_change=-0.681]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0107, loss_rel_change=-0.679]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0105, loss_rel_change=-0.682]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0107, loss_rel_change=-0.678]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0104, loss_rel_change=-0.685]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0108, loss_rel_change=-0.675]
Sparse reweighting progress: 74%|███████▍ | 297/400 [00:00<00:00, 586.29epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0106, loss_rel_change=-0.68]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0107, loss_rel_change=-0.677]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.685]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0104, loss_rel_change=-0.687]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0106, loss_rel_change=-0.681]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.684]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0107, loss_rel_change=-0.677]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0106, loss_rel_change=-0.68]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.011, loss_rel_change=-0.668]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0103, loss_rel_change=-0.69]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0109, loss_rel_change=-0.67]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0103, loss_rel_change=-0.689]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0104, loss_rel_change=-0.686]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0108, loss_rel_change=-0.674]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0103, loss_rel_change=-0.689]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.685]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0106, loss_rel_change=-0.682]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0104, loss_rel_change=-0.686]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0104, loss_rel_change=-0.688]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0103, loss_rel_change=-0.69]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0107, loss_rel_change=-0.679]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0102, loss_rel_change=-0.692]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0102, loss_rel_change=-0.692]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0104, loss_rel_change=-0.686]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0102, loss_rel_change=-0.691]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0101, loss_rel_change=-0.696]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0105, loss_rel_change=-0.683]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0101, loss_rel_change=-0.694]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0101, loss_rel_change=-0.696]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0104, loss_rel_change=-0.685]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.01, loss_rel_change=-0.698]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0102, loss_rel_change=-0.693]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0102, loss_rel_change=-0.692]
Sparse reweighting progress: 89%|████████▉ | 356/400 [00:00<00:00, 585.70epoch/s, loss=0.0102, loss_rel_change=-0.693]
Sparse reweighting progress: 100%|██████████| 400/400 [00:00<00:00, 581.24epoch/s, loss=0.0102, loss_rel_change=-0.693]
Comparison complete!
# Compare results
def evaluate_calibration(weights, estimate_matrix, targets, label):
estimates = (estimate_matrix.T * weights).sum(axis=1).values
rel_errors = np.abs((estimates - targets) / targets)
return {
'Label': label,
'Non-zero weights': np.sum(weights != 0),
'Sparsity': f"{100 * np.mean(weights == 0):.1f}%",
'Mean rel error': f"{np.mean(rel_errors):.4f}",
'Max rel error': f"{np.max(rel_errors):.4f}",
'Within 1%': f"{100 * np.mean(rel_errors < 0.01):.1f}%",
'Within 5%': f"{100 * np.mean(rel_errors < 0.05):.1f}%",
'Within 10%': f"{100 * np.mean(rel_errors < 0.10):.1f}%",
}
comparison = pd.DataFrame([
evaluate_calibration(weights_default, estimate_matrix, targets, 'Default params'),
evaluate_calibration(weights_tuned, estimate_matrix, targets, 'Tuned params'),
])
print("\nParameter comparison:")
print(comparison.to_string(index=False))
print("\n" + "="*50)
print("Improvement summary:")
sparsity_default = np.mean(weights_default == 0)
sparsity_tuned = np.mean(weights_tuned == 0)
print(f"Sparsity improvement: {sparsity_tuned - sparsity_default:.1%}")
print(f"Dataset reduction: {100*sparsity_tuned:.1f}% of records can be dropped")
print(f"Remaining records: {np.sum(weights_tuned != 0):,} out of {len(weights_tuned):,}")
Parameter comparison:
Label Non-zero weights Sparsity Mean rel error Max rel error Within 1% Within 5% Within 10%
Default params 1997 60.1% 0.0102 0.0250 50.0% 100.0% 100.0%
Tuned params 1372 72.6% 0.1008 0.1155 0.0% 0.0% 40.0%
==================================================
Improvement summary:
Sparsity improvement: 12.5%
Dataset reduction: 72.6% of records can be dropped
Remaining records: 1,372 out of 5,000
Advanced tuning with custom objectives¶
You can customize the tuning process by adjusting the objective balance. Here’s how different balances affect the results:
# Different objective balances for different use cases
objective_configs = {
'Accuracy-focused': {'loss': 1.0, 'accuracy': 200.0, 'sparsity': 1.0},
'Sparsity-focused': {'loss': 1.0, 'accuracy': 50.0, 'sparsity': 50.0},
'Balanced': {'loss': 1.0, 'accuracy': 100.0, 'sparsity': 10.0},
}
results = []
for name, objectives in objective_configs.items():
print(f"\nTuning with {name} objectives...")
cal_temp = Calibration(
weights=weights_init.copy(),
targets=targets,
estimate_matrix=estimate_matrix,
epochs=100,
learning_rate=1e-3,
)
params = cal_temp.tune_l0_hyperparameters(
n_trials=10, # Fewer trials for demonstration
objectives_balance=objectives,
n_holdout_sets=2,
holdout_fraction=0.2,
epochs_per_trial=30,
)
results.append({
'Config': name,
'l0_lambda': f"{params['l0_lambda']:.2e}",
'Accuracy': f"{params['mean_val_accuracy']:.1%}",
'Sparsity': f"{params['sparsity']:.1%}",
})
results_df = pd.DataFrame(results)
print("\n" + "="*50)
print("Objective balance comparison:")
print(results_df.to_string(index=False))
Data leakage warning: Targets often share overlapping information (e.g., geographic breakdowns like 'snap in CA' and 'snap in US'). Holdout validation may not provide complete isolation between training and validation sets. The robustness metrics should be interpreted with this limitation in mind - they may overestimate the model's true generalization performance.
Tuning with Accuracy-focused objectives...
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=19.7, weights_mean=6, weights_std=2.89, weights_min=1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=19.3, weights_mean=5.94, weights_std=2.86, weights_min=0.99]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=18.8, weights_mean=5.88, weights_std=2.83, weights_min=0.98]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1332.19epoch/s, loss=18.8, weights_mean=5.88, weights_std=2.83, weights_min=0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0542, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0288, loss_rel_change=-0.468]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.047, loss_rel_change=-0.132]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0346, loss_rel_change=-0.362]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0331, loss_rel_change=-0.39]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0367, loss_rel_change=-0.324]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.034, loss_rel_change=-0.372]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0299, loss_rel_change=-0.448]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0329, loss_rel_change=-0.393]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0314, loss_rel_change=-0.42]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.475]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0297, loss_rel_change=-0.453]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.03, loss_rel_change=-0.447]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.029, loss_rel_change=-0.464]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0293, loss_rel_change=-0.459]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.471]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0298, loss_rel_change=-0.45]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0283, loss_rel_change=-0.479]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0284, loss_rel_change=-0.476]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0285, loss_rel_change=-0.475]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0283, loss_rel_change=-0.478]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.27epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 349.40epoch/s, loss=0.0282, loss_rel_change=-0.479]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=78.4, weights_mean=10.8, weights_std=3.99, weights_min=1.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=76.7, weights_mean=10.7, weights_std=3.95, weights_min=1.29]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=75, weights_mean=10.6, weights_std=3.91, weights_min=1.27]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1435.90epoch/s, loss=75, weights_mean=10.6, weights_std=3.91, weights_min=1.27]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.66, loss_rel_change=-0.423]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.04, loss_rel_change=-0.664]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.86, loss_rel_change=-0.809]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.59, loss_rel_change=-0.894]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.849, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.44, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0952, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0432, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0335, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0478, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0712, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0912, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.117, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.158, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.178, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.195, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.205, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.22, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.235, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.249, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.254, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.259, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.267, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.268, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.277, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.274, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.278, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.272, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.274, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.273, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.27, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.266, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.266, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.263, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.259, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.251, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.252, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.244, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.239, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.234, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.227, loss_rel_change=-0.985]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.218, loss_rel_change=-0.985]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.211, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.207, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.205, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.195, loss_rel_change=-0.987]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.191, loss_rel_change=-0.987]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.18, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.172, loss_rel_change=-0.989]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.163, loss_rel_change=-0.989]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.15, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.151, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.144, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.134, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.127, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.121, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.45epoch/s, loss=0.112, loss_rel_change=-0.993]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 351.25epoch/s, loss=0.112, loss_rel_change=-0.993]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=170, weights_mean=15.5, weights_std=4.88, weights_min=2.04]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=167, weights_mean=15.3, weights_std=4.83, weights_min=2.02]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=163, weights_mean=15.2, weights_std=4.78, weights_min=2]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1433.02epoch/s, loss=163, weights_mean=15.2, weights_std=4.78, weights_min=2]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=18.7, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.98, loss_rel_change=-0.466]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.49, loss_rel_change=-0.706]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.86, loss_rel_change=-0.847]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43, loss_rel_change=-0.923]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.691, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.254, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0636, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0611, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0852, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0992, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.154, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.19, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.216, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.245, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.265, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.302, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.328, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.341, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.348, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.357, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.377, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.4, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.403, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.411, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.406, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.44, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.403, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.394, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.419, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.404, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.355, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.376, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.355, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.345, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.345, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.316, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.348, loss_rel_change=-0.981]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.269, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.27, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.219, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.2, loss_rel_change=-0.989]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.186, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.149, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.176, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.134, loss_rel_change=-0.993]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0924, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.12, loss_rel_change=-0.994]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.103, loss_rel_change=-0.994]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0837, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.089, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0584, loss_rel_change=-0.997]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0666, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0805, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0623, loss_rel_change=-0.997]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0724, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0792, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0671, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0549, loss_rel_change=-0.997]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.77epoch/s, loss=0.0668, loss_rel_change=-0.996]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 349.21epoch/s, loss=0.0668, loss_rel_change=-0.996]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=296, weights_mean=20, weights_std=5.56, weights_min=2.46]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=290, weights_mean=19.8, weights_std=5.51, weights_min=2.43]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=284, weights_mean=19.6, weights_std=5.45, weights_min=2.41]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1423.71epoch/s, loss=284, weights_mean=19.6, weights_std=5.45, weights_min=2.41]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=42.8, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=25.4, loss_rel_change=-0.405]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.7, loss_rel_change=-0.679]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.84, loss_rel_change=-0.817]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.51, loss_rel_change=-0.895]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.28, loss_rel_change=-0.947]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.22, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.664, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.292, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.163, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0694, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0559, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0605, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0723, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.102, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.146, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.174, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.211, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.229, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.254, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.254, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.297, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.314, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.311, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.308, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.348, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.338, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.362, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.366, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.353, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.357, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.369, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.378, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.368, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.368, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.368, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.361, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.369, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.382, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.37, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.396, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.404, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.366, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.354, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.359, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.332, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.348, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.362, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.327, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.337, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.299, loss_rel_change=-0.993]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.301, loss_rel_change=-0.993]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.273, loss_rel_change=-0.994]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.261, loss_rel_change=-0.994]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.248, loss_rel_change=-0.994]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.221, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.265, loss_rel_change=-0.994]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.193, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.216, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 358.23epoch/s, loss=0.179, loss_rel_change=-0.996]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 353.68epoch/s, loss=0.179, loss_rel_change=-0.996]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=450, weights_mean=24.5, weights_std=6.12, weights_min=2.77]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=441, weights_mean=24.2, weights_std=6.06, weights_min=2.75]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=432, weights_mean=24, weights_std=6, weights_min=2.72]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1462.91epoch/s, loss=432, weights_mean=24, weights_std=6, weights_min=2.72]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=202, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=124, loss_rel_change=-0.386]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=81, loss_rel_change=-0.599]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=51.4, loss_rel_change=-0.746]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=32.3, loss_rel_change=-0.84]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.1, loss_rel_change=-0.896]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.5, loss_rel_change=-0.928]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.96, loss_rel_change=-0.951]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.54, loss_rel_change=-0.968]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.53, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.03, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.28, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.57, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.13, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.8, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.573, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.404, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.269, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.176, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0728, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0496, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0407, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0205, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0153, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00788, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0072, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00668, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00796, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0104, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0146, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0163, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.021, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0254, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0234, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0276, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0276, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0287, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0421, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0406, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0392, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0427, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0446, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0494, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0521, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0484, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0501, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0575, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0546, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0606, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0576, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.058, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0527, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0588, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.058, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0576, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.059, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0648, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.06, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0634, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.38epoch/s, loss=0.0608, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 344.40epoch/s, loss=0.0608, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=633, weights_mean=28.8, weights_std=6.66, weights_min=8.57]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=620, weights_mean=28.5, weights_std=6.6, weights_min=8.48]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=607, weights_mean=28.2, weights_std=6.53, weights_min=8.4]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1444.30epoch/s, loss=607, weights_mean=28.2, weights_std=6.53, weights_min=8.4]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=313, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=193, loss_rel_change=-0.384]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=124, loss_rel_change=-0.603]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=80.1, loss_rel_change=-0.744]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=51.9, loss_rel_change=-0.834]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=34.2, loss_rel_change=-0.891]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.9, loss_rel_change=-0.927]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.1, loss_rel_change=-0.948]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.5, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.9, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.75, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.15, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.94, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.22, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.7, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.21, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.913, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.658, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.531, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.397, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.29, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.218, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.16, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.116, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.093, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.065, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0529, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0427, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0208, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0149, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00899, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00724, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00677, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00658, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.00658, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.00642, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.00721, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.00789, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.00848, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.00974, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0089, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.00969, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0118, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0155, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0158, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.016, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0153, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0174, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0203, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0188, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0194, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0183, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0184, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.0192, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.48epoch/s, loss=0.023, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 350.06epoch/s, loss=0.023, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=836, weights_mean=32.9, weights_std=7.09, weights_min=10.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=819, weights_mean=32.6, weights_std=7.02, weights_min=10.7]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=802, weights_mean=32.3, weights_std=6.95, weights_min=10.6]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1475.93epoch/s, loss=802, weights_mean=32.3, weights_std=6.95, weights_min=10.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=139, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=81.8, loss_rel_change=-0.41]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=47.2, loss_rel_change=-0.66]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.5, loss_rel_change=-0.794]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.8, loss_rel_change=-0.879]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.5, loss_rel_change=-0.925]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.31, loss_rel_change=-0.955]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.47, loss_rel_change=-0.968]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.69, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.75, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.11, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.742, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.489, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.319, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.238, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.143, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.156, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.173, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.216, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.223, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.233, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.226, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.232, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.245, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.256, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.243, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.243, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.261, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.255, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.261, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.271, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.268, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.291, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.264, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.278, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.267, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.273, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.278, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.29, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.283, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.291, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.277, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.293, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.294, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.282, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.286, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.283, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.276, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.27, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.279, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.92epoch/s, loss=0.271, loss_rel_change=-0.998]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 340.84epoch/s, loss=0.271, loss_rel_change=-0.998]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.06e+3, weights_mean=37, weights_std=7.46, weights_min=12.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.04e+3, weights_mean=36.6, weights_std=7.39, weights_min=12.6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.02e+3, weights_mean=36.3, weights_std=7.32, weights_min=12.5]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1498.84epoch/s, loss=1.02e+3, weights_mean=36.3, weights_std=7.32, weights_min=12.5]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=178, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=110, loss_rel_change=-0.384]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=62.9, loss_rel_change=-0.647]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=38.9, loss_rel_change=-0.782]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.9, loss_rel_change=-0.871]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.3, loss_rel_change=-0.914]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9, loss_rel_change=-0.949]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.84, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.57, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.63, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.12, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.794, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.537, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.391, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.298, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.206, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.166, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.141, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.143, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.166, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.181, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.185, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.199, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.216, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.207, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.207, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.233, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.222, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.224, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.238, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.246, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.246, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.251, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.25, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.242, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.248, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.245, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.256, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.252, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.257, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.249, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.25, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.247, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.251, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.264, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.243, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.251, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.61epoch/s, loss=0.256, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 365.22epoch/s, loss=0.256, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.31e+3, weights_mean=40.9, weights_std=7.79, weights_min=13.9]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.28e+3, weights_mean=40.5, weights_std=7.72, weights_min=13.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.26e+3, weights_mean=40.1, weights_std=7.64, weights_min=13.6]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1227.27epoch/s, loss=1.26e+3, weights_mean=40.1, weights_std=7.64, weights_min=13.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=332, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=187, loss_rel_change=-0.437]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=121, loss_rel_change=-0.635]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=70.1, loss_rel_change=-0.789]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=46.8, loss_rel_change=-0.859]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=25.9, loss_rel_change=-0.922]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.5, loss_rel_change=-0.947]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.4, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.73, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.93, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.57, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.29, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.71, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.15, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.798, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.542, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.366, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.323, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.215, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.208, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.169, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.167, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.173, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.168, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.183, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.201, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.192, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.232, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.217, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.21, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.217, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.226, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.209, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.206, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.228, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.213, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.226, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.213, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.236, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.255, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.239, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.223, loss_rel_change=-0.999]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.75epoch/s, loss=0.234, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 326.64epoch/s, loss=0.234, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.57e+3, weights_mean=44.7, weights_std=8.1, weights_min=14.5]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.54e+3, weights_mean=44.3, weights_std=8.02, weights_min=14.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.51e+3, weights_mean=43.9, weights_std=7.94, weights_min=14.3]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1405.32epoch/s, loss=1.51e+3, weights_mean=43.9, weights_std=7.94, weights_min=14.3]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=428, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=233, loss_rel_change=-0.456]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=147, loss_rel_change=-0.657]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=88.9, loss_rel_change=-0.792]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=55.4, loss_rel_change=-0.87]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=33.7, loss_rel_change=-0.921]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.1, loss_rel_change=-0.948]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.4, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.84, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.29, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.62, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.11, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.43, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.6, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.929, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.61, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.354, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.334, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.265, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.202, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.192, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.141, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.13, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.141, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.162, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.162, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.172, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.17, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.174, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.172, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.194, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.183, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.195, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.173, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.17, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.185, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.18, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.176, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.183, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.186, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.174, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.185, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.205, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.195, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 340.95epoch/s, loss=0.177, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 329.43epoch/s, loss=0.177, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.85e+3, weights_mean=48.4, weights_std=8.38, weights_min=19.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.81e+3, weights_mean=48, weights_std=8.29, weights_min=19.2]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.77e+3, weights_mean=47.5, weights_std=8.21, weights_min=19]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1244.75epoch/s, loss=1.77e+3, weights_mean=47.5, weights_std=8.21, weights_min=19]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=520, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=311, loss_rel_change=-0.402]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=184, loss_rel_change=-0.646]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=118, loss_rel_change=-0.772]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=74.8, loss_rel_change=-0.856]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=48.4, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=30.4, loss_rel_change=-0.942]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.8, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.81, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.59, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.46, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.42, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.29, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.79, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.22, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.826, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.788, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.46, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.312, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.178, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0861, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0648, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0536, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0365, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0297, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0177, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0172, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00992, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.00992, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0162, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0135, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.016, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0262, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0205, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0263, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0382, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0206, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0277, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.034, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0289, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0356, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0346, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0345, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0237, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0278, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0307, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0413, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0358, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0396, loss_rel_change=-1]
Sparse reweighting progress: 55%|█████▌ | 33/60 [00:00<00:00, 327.63epoch/s, loss=0.0374, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 323.54epoch/s, loss=0.0374, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.15e+3, weights_mean=52.1, weights_std=8.65, weights_min=20.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.11e+3, weights_mean=51.6, weights_std=8.57, weights_min=20.6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.06e+3, weights_mean=51.1, weights_std=8.48, weights_min=20.3]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1248.90epoch/s, loss=2.06e+3, weights_mean=51.1, weights_std=8.48, weights_min=20.3]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=620, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=367, loss_rel_change=-0.408]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=219, loss_rel_change=-0.648]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=141, loss_rel_change=-0.772]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=87.9, loss_rel_change=-0.858]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=57.9, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=36.5, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=23.9, loss_rel_change=-0.961]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.3, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.42, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.94, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.17, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.28, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.37, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.7, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.28, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.856, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.664, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.517, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.417, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.317, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.233, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.225, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.117, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.106, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0763, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0722, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0451, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0348, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0308, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0181, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0111, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0102, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00951, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.00951, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0138, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0157, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0145, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0148, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0127, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0176, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0141, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0183, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0165, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0248, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.025, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0214, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0224, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0193, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.024, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0219, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.25epoch/s, loss=0.0206, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 355.25epoch/s, loss=0.0206, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.45e+3, weights_mean=55.6, weights_std=8.88, weights_min=25.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.4e+3, weights_mean=55, weights_std=8.79, weights_min=25.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.35e+3, weights_mean=54.5, weights_std=8.7, weights_min=24.9]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1252.87epoch/s, loss=2.35e+3, weights_mean=54.5, weights_std=8.7, weights_min=24.9]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=683, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=408, loss_rel_change=-0.402]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=247, loss_rel_change=-0.638]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=152, loss_rel_change=-0.777]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=95.5, loss_rel_change=-0.86]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=61.6, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=44, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.5, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.3, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.3, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.96, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.16, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.05, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.04, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.81, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.14, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.74, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.31, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.818, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.676, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.568, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.421, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.355, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.31, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.222, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.208, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.152, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.11, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.111, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0786, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0596, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0746, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.044, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0581, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0386, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0359, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0321, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0321, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0338, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0373, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0331, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0335, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0335, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0324, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0305, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0307, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.031, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0332, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0336, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.031, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0352, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0338, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0354, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0313, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0326, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0341, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0329, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.50epoch/s, loss=0.0319, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 357.06epoch/s, loss=0.0319, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.76e+3, weights_mean=58.9, weights_std=9.06, weights_min=26.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.7e+3, weights_mean=58.4, weights_std=8.97, weights_min=26]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.65e+3, weights_mean=57.8, weights_std=8.89, weights_min=25.7]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1414.00epoch/s, loss=2.65e+3, weights_mean=57.8, weights_std=8.89, weights_min=25.7]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=799, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=469, loss_rel_change=-0.413]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=289, loss_rel_change=-0.639]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=177, loss_rel_change=-0.779]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=113, loss_rel_change=-0.859]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=74.4, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=49.1, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=33.6, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.3, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.1, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.6, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.42, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.22, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.26, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.45, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.47, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.05, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.53, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.33, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.02, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.751, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.576, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.487, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.439, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.322, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.244, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.215, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.112, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.111, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0779, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0768, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.077, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0755, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0593, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.047, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.047, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0456, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0452, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0504, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.045, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0433, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0469, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0413, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0404, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0331, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0354, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0368, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0319, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0317, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0324, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0302, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0298, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0313, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0328, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0299, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0307, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 361.47epoch/s, loss=0.0323, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 357.42epoch/s, loss=0.0323, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.08e+3, weights_mean=62.3, weights_std=9.24, weights_min=28.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.02e+3, weights_mean=61.7, weights_std=9.15, weights_min=28.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.96e+3, weights_mean=61.1, weights_std=9.06, weights_min=27.8]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1302.96epoch/s, loss=2.96e+3, weights_mean=61.1, weights_std=9.06, weights_min=27.8]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=943, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=563, loss_rel_change=-0.403]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=358, loss_rel_change=-0.62]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=213, loss_rel_change=-0.775]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=132, loss_rel_change=-0.86]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=87.7, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=60, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=38.3, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=25.8, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.7, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.7, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.56, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.08, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.47, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.82, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.89, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.38, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.62, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.52, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.05, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.904, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.636, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.548, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.385, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.304, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.277, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.183, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.217, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0891, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.116, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0824, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0715, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0715, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0375, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0562, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0271, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0233, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0348, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0258, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0221, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0217, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0157, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0122, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0185, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0146, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0168, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0139, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0124, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0117, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.0139, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00952, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00785, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00863, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00826, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00912, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00804, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00721, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.78epoch/s, loss=0.00722, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 331.96epoch/s, loss=0.00722, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.42e+3, weights_mean=65.6, weights_std=9.36, weights_min=30.9]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.35e+3, weights_mean=64.9, weights_std=9.27, weights_min=30.5]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.29e+3, weights_mean=64.3, weights_std=9.17, weights_min=30.2]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1408.93epoch/s, loss=3.29e+3, weights_mean=64.3, weights_std=9.17, weights_min=30.2]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.08e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=623, loss_rel_change=-0.423]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=379, loss_rel_change=-0.65]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=243, loss_rel_change=-0.775]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=156, loss_rel_change=-0.856]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=98.9, loss_rel_change=-0.908]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=66.3, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=44.4, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=29.7, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.2, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.2, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.92, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.26, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.44, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.73, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.05, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.82, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.42, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.924, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.836, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.617, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.625, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.466, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.397, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.307, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.285, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.274, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0818, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.106, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0933, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0835, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0835, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0441, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0498, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0435, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0431, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0457, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0236, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0371, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0295, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0239, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0228, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0326, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0184, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.02, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0164, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0184, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0164, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0163, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0156, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.019, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0119, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.00902, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0162, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.05epoch/s, loss=0.0185, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 351.51epoch/s, loss=0.0185, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.76e+3, weights_mean=68.7, weights_std=9.6, weights_min=32.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.69e+3, weights_mean=68.1, weights_std=9.51, weights_min=32.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.61e+3, weights_mean=67.4, weights_std=9.41, weights_min=31.8]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1411.54epoch/s, loss=3.61e+3, weights_mean=67.4, weights_std=9.41, weights_min=31.8]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.38e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.48e+3, loss_rel_change=-0.381]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=977, loss_rel_change=-0.59]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=630, loss_rel_change=-0.736]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=424, loss_rel_change=-0.822]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=298, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=204, loss_rel_change=-0.914]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=148, loss_rel_change=-0.938]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=112, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=79.9, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=56.9, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=44.7, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=36.3, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.8, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.7, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.7, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.8, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=12.1, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.78, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.98, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.23, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.36, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.64, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.96, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.67, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.09, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.83, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.74, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.42, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.3, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.08, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.96, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.68, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=1.39, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=1.22, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.987, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.988, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.889, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.856, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.814, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.81, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.86, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.702, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.755, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.831, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.783, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.764, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.643, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.776, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.735, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.771, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.26epoch/s, loss=0.677, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 362.34epoch/s, loss=0.677, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.11e+3, weights_mean=71.7, weights_std=9.73, weights_min=31.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.03e+3, weights_mean=71, weights_std=9.63, weights_min=31.5]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.95e+3, weights_mean=70.3, weights_std=9.54, weights_min=31.1]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1444.05epoch/s, loss=3.95e+3, weights_mean=70.3, weights_std=9.54, weights_min=31.1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.58e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.64e+3, loss_rel_change=-0.363]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.07e+3, loss_rel_change=-0.584]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=704, loss_rel_change=-0.727]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=473, loss_rel_change=-0.817]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=323, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=232, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=163, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=115, loss_rel_change=-0.956]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=86.4, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=65.3, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=49.5, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=40.4, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=29.9, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=24.8, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.1, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.6, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.79, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.99, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.96, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.28, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.61, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.11, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.54, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.27, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.02, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.78, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.07, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.12, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.87, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.77, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.77, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.53, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.5, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.34, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.17, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.28, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.979, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.941, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.931, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.846, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.963, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.852, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.852, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.784, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.818, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.805, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.74epoch/s, loss=0.796, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 355.35epoch/s, loss=0.796, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.46e+3, weights_mean=74.7, weights_std=9.87, weights_min=38.7]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.37e+3, weights_mean=74, weights_std=9.77, weights_min=38.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.29e+3, weights_mean=73.3, weights_std=9.68, weights_min=37.9]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1236.18epoch/s, loss=4.29e+3, weights_mean=73.3, weights_std=9.68, weights_min=37.9]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.31e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43e+3, loss_rel_change=-0.383]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=933, loss_rel_change=-0.597]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=609, loss_rel_change=-0.737]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=388, loss_rel_change=-0.832]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=266, loss_rel_change=-0.885]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=187, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=132, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=87, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=67.4, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=48.6, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=36.4, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.6, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.2, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=12.7, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.34, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.44, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.49, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.76, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.18, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.83, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.04, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.74, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.4, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.3, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.77, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.67, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.57, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.56, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.24, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.07, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.25, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.967, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.86, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.846, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.846, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.822, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.661, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.721, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.691, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.569, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.686, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.508, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.551, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.512, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.494, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.505, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.493, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.455, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.458, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.431, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.465, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.466, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.484, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.459, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.454, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.48, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.458, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.50epoch/s, loss=0.364, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 356.95epoch/s, loss=0.364, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.81e+3, weights_mean=77.5, weights_std=10, weights_min=41.7]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.71e+3, weights_mean=76.8, weights_std=9.94, weights_min=41.2]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.61e+3, weights_mean=76, weights_std=9.85, weights_min=40.8]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1451.55epoch/s, loss=4.61e+3, weights_mean=76, weights_std=9.85, weights_min=40.8]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.52e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.59e+3, loss_rel_change=-0.368]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=990, loss_rel_change=-0.608]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=636, loss_rel_change=-0.748]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=426, loss_rel_change=-0.831]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=293, loss_rel_change=-0.884]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=204, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=141, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=102, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=75.3, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=52.5, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=41, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=31, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=23.2, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.1, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.8, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.4, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.26, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.72, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.21, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.61, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.18, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.17, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.88, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.31, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.18, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.62, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.22, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.64, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.44, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.38, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.39, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.965, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.965, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.975, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.975, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.803, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.81, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.704, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.722, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.703, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.623, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.808, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.611, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.72, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.625, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.555, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.556, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.533, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.605, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.557, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.528, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.44, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.532, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.478, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.478, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.43epoch/s, loss=0.539, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 352.39epoch/s, loss=0.539, loss_rel_change=-1]
Data leakage warning: Targets often share overlapping information (e.g., geographic breakdowns like 'snap in CA' and 'snap in US'). Holdout validation may not provide complete isolation between training and validation sets. The robustness metrics should be interpreted with this limitation in mind - they may overestimate the model's true generalization performance.
Tuning with Sparsity-focused objectives...
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=19.3, weights_mean=5.96, weights_std=2.86, weights_min=1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=18.8, weights_mean=5.9, weights_std=2.83, weights_min=0.991]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=18.4, weights_mean=5.85, weights_std=2.81, weights_min=0.981]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1227.07epoch/s, loss=18.4, weights_mean=5.85, weights_std=2.81, weights_min=0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0542, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0288, loss_rel_change=-0.468]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.047, loss_rel_change=-0.132]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0346, loss_rel_change=-0.362]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0331, loss_rel_change=-0.39]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0367, loss_rel_change=-0.324]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.034, loss_rel_change=-0.372]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0299, loss_rel_change=-0.448]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0329, loss_rel_change=-0.393]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0314, loss_rel_change=-0.42]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.475]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0297, loss_rel_change=-0.453]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.03, loss_rel_change=-0.447]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.029, loss_rel_change=-0.464]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0293, loss_rel_change=-0.459]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.471]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0298, loss_rel_change=-0.45]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0283, loss_rel_change=-0.479]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0284, loss_rel_change=-0.476]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0285, loss_rel_change=-0.475]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0283, loss_rel_change=-0.478]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.15epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 352.17epoch/s, loss=0.0282, loss_rel_change=-0.479]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=77.4, weights_mean=10.8, weights_std=4.05, weights_min=1.11]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=75.7, weights_mean=10.7, weights_std=4.01, weights_min=1.09]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=74.1, weights_mean=10.6, weights_std=3.97, weights_min=1.08]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1430.28epoch/s, loss=74.1, weights_mean=10.6, weights_std=3.97, weights_min=1.08]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.5, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.4, loss_rel_change=-0.42]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.92, loss_rel_change=-0.66]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.73, loss_rel_change=-0.811]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.52, loss_rel_change=-0.895]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.794, loss_rel_change=-0.945]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.413, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.188, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0837, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0406, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0344, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0492, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.075, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0952, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.12, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.141, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.16, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.181, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.198, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.209, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.223, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.238, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.252, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.256, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.262, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.268, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.272, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.276, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.276, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.278, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.273, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.275, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.274, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.268, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.264, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.264, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.263, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.258, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.252, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.25, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.243, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.239, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.233, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.227, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.215, loss_rel_change=-0.985]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.207, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.203, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.201, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.194, loss_rel_change=-0.987]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.187, loss_rel_change=-0.987]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.176, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.167, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.162, loss_rel_change=-0.989]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.148, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.147, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.139, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.128, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.125, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.117, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.04epoch/s, loss=0.106, loss_rel_change=-0.993]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 353.56epoch/s, loss=0.106, loss_rel_change=-0.993]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=171, weights_mean=15.5, weights_std=4.87, weights_min=2.42]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=168, weights_mean=15.4, weights_std=4.82, weights_min=2.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=164, weights_mean=15.2, weights_std=4.77, weights_min=2.37]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1440.93epoch/s, loss=164, weights_mean=15.2, weights_std=4.77, weights_min=2.37]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=18.5, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.2, loss_rel_change=-0.452]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.31, loss_rel_change=-0.713]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.86, loss_rel_change=-0.846]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.36, loss_rel_change=-0.927]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.647, loss_rel_change=-0.965]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.26, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0599, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0595, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0828, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.101, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.153, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.189, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.222, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.243, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.259, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.294, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.329, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.341, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.35, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.352, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.373, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.401, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.396, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.407, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.406, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.427, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.398, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.378, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.418, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.407, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.359, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.378, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.355, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.332, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.332, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.307, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.337, loss_rel_change=-0.982]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.255, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.264, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.221, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.217, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.212, loss_rel_change=-0.989]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.166, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.168, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.137, loss_rel_change=-0.993]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0851, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0842, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0793, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0969, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.12, loss_rel_change=-0.994]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0733, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0885, loss_rel_change=-0.995]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0718, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0703, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0591, loss_rel_change=-0.997]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0826, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0656, loss_rel_change=-0.996]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0545, loss_rel_change=-0.997]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.35epoch/s, loss=0.0647, loss_rel_change=-0.997]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 350.05epoch/s, loss=0.0647, loss_rel_change=-0.997]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=298, weights_mean=20.1, weights_std=5.59, weights_min=3.57]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=292, weights_mean=19.9, weights_std=5.54, weights_min=3.54]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=285, weights_mean=19.7, weights_std=5.48, weights_min=3.5]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1438.33epoch/s, loss=285, weights_mean=19.7, weights_std=5.48, weights_min=3.5]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=42.4, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=25.4, loss_rel_change=-0.4]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14, loss_rel_change=-0.67]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.73, loss_rel_change=-0.818]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.4, loss_rel_change=-0.896]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.34, loss_rel_change=-0.945]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.19, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.68, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.304, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0669, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0553, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0602, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.075, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.101, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.152, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.206, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.221, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.301, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.308, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.312, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.31, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.334, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.336, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.365, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.367, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.357, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.368, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.376, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.377, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.371, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.363, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.359, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.359, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.366, loss_rel_change=-0.991]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.382, loss_rel_change=-0.991]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.371, loss_rel_change=-0.991]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.398, loss_rel_change=-0.991]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.409, loss_rel_change=-0.99]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.368, loss_rel_change=-0.991]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.364, loss_rel_change=-0.991]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.355, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.329, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.353, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.353, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.329, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.329, loss_rel_change=-0.992]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.288, loss_rel_change=-0.993]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.287, loss_rel_change=-0.993]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.266, loss_rel_change=-0.994]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.244, loss_rel_change=-0.994]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.229, loss_rel_change=-0.995]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.21, loss_rel_change=-0.995]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.267, loss_rel_change=-0.994]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.201, loss_rel_change=-0.995]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.221, loss_rel_change=-0.995]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.33epoch/s, loss=0.182, loss_rel_change=-0.996]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 360.54epoch/s, loss=0.182, loss_rel_change=-0.996]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=451, weights_mean=24.5, weights_std=6.15, weights_min=4.9]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=442, weights_mean=24.3, weights_std=6.09, weights_min=4.85]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=433, weights_mean=24.1, weights_std=6.03, weights_min=4.8]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1429.78epoch/s, loss=433, weights_mean=24.1, weights_std=6.03, weights_min=4.8]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=203, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=125, loss_rel_change=-0.382]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=81.8, loss_rel_change=-0.597]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=51.6, loss_rel_change=-0.746]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=32.3, loss_rel_change=-0.841]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.2, loss_rel_change=-0.896]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.5, loss_rel_change=-0.928]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.95, loss_rel_change=-0.951]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.53, loss_rel_change=-0.968]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.58, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.01, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.29, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.58, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.15, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.805, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.568, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.406, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.275, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.076, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0494, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0402, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0211, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0152, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0077, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0069, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00647, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00794, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0108, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0148, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0156, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0203, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0245, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0233, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0276, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0279, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0279, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0415, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0407, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0398, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0434, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0448, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0478, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0537, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0467, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0498, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0552, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0559, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0622, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0587, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0591, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0508, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0582, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0577, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0558, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0599, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0646, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0612, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0621, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.29epoch/s, loss=0.0601, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 343.85epoch/s, loss=0.0601, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=634, weights_mean=28.8, weights_std=6.64, weights_min=5.93]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=621, weights_mean=28.6, weights_std=6.58, weights_min=5.87]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=608, weights_mean=28.3, weights_std=6.51, weights_min=5.81]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1468.54epoch/s, loss=608, weights_mean=28.3, weights_std=6.51, weights_min=5.81]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=313, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=194, loss_rel_change=-0.379]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=125, loss_rel_change=-0.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=80.1, loss_rel_change=-0.744]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=52.3, loss_rel_change=-0.833]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=34.3, loss_rel_change=-0.891]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.9, loss_rel_change=-0.927]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.1, loss_rel_change=-0.949]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.5, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.9, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.75, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.17, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.98, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.22, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.73, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.23, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.926, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.653, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.538, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.396, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.296, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.22, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.116, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0915, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0648, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0567, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.045, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0314, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0211, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0158, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0144, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00966, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00712, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0075, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00661, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0066, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00721, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.00721, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.00763, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0082, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0093, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.00899, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.00912, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0122, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0123, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0115, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0149, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0164, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0159, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.015, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0204, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0191, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0181, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0186, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0187, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0189, loss_rel_change=-1]
Sparse reweighting progress: 63%|██████▎ | 38/60 [00:00<00:00, 370.82epoch/s, loss=0.0228, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 365.85epoch/s, loss=0.0228, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=842, weights_mean=33.1, weights_std=7.1, weights_min=8.43]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=825, weights_mean=32.8, weights_std=7.03, weights_min=8.34]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=808, weights_mean=32.5, weights_std=6.96, weights_min=8.26]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1438.57epoch/s, loss=808, weights_mean=32.5, weights_std=6.96, weights_min=8.26]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=138, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=81.2, loss_rel_change=-0.414]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=47.4, loss_rel_change=-0.658]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.4, loss_rel_change=-0.795]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.6, loss_rel_change=-0.88]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.4, loss_rel_change=-0.925]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.26, loss_rel_change=-0.955]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.51, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.69, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.75, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.13, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.737, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.482, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.317, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.24, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.178, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.143, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.124, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.158, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.173, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.193, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.217, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.221, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.23, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.234, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.23, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.245, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.248, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.248, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.261, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.255, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.263, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.272, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.269, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.291, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.263, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.277, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.265, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.27, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.283, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.288, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.28, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.291, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.279, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.294, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.289, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.281, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.287, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.283, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.276, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.271, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.277, loss_rel_change=-0.998]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.06epoch/s, loss=0.269, loss_rel_change=-0.998]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 341.27epoch/s, loss=0.269, loss_rel_change=-0.998]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.07e+3, weights_mean=37.2, weights_std=7.44, weights_min=9.28]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.05e+3, weights_mean=36.8, weights_std=7.37, weights_min=9.18]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.03e+3, weights_mean=36.4, weights_std=7.29, weights_min=9.09]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1332.72epoch/s, loss=1.03e+3, weights_mean=36.4, weights_std=7.29, weights_min=9.09]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=181, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=111, loss_rel_change=-0.386]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=64, loss_rel_change=-0.646]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=39.3, loss_rel_change=-0.783]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=23.2, loss_rel_change=-0.871]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.7, loss_rel_change=-0.913]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.02, loss_rel_change=-0.95]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.15, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.89, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.6, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.68, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.16, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.796, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.539, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.403, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.299, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.209, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.171, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.126, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.13, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.141, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.144, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.165, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.181, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.196, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.2, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.2, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.213, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.22, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.223, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.235, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.245, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.245, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.251, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.252, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.24, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.247, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.247, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.251, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.247, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.255, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.246, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.248, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.248, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.251, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.26, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.244, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.248, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.70epoch/s, loss=0.253, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 363.55epoch/s, loss=0.253, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.32e+3, weights_mean=41.2, weights_std=7.72, weights_min=13.7]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.29e+3, weights_mean=40.8, weights_std=7.64, weights_min=13.6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.27e+3, weights_mean=40.4, weights_std=7.57, weights_min=13.4]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1460.33epoch/s, loss=1.27e+3, weights_mean=40.4, weights_std=7.57, weights_min=13.4]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=330, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=190, loss_rel_change=-0.423]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=121, loss_rel_change=-0.632]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=70.4, loss_rel_change=-0.787]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=47.1, loss_rel_change=-0.857]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=26.4, loss_rel_change=-0.92]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.4, loss_rel_change=-0.947]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.4, loss_rel_change=-0.965]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.86, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.93, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.54, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.22, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.7, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.15, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.809, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.574, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.372, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.328, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.215, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.208, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.168, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.15, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.138, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.147, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.196, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.162, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.199, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.195, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.177, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.203, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.19, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.231, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.215, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.21, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.229, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.218, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.226, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.208, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.211, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.218, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.222, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.217, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.237, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.249, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.239, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.223, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 366.97epoch/s, loss=0.235, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 361.07epoch/s, loss=0.235, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.59e+3, weights_mean=45, weights_std=8.1, weights_min=15.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.56e+3, weights_mean=44.5, weights_std=8.02, weights_min=15.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.53e+3, weights_mean=44.1, weights_std=7.94, weights_min=15.1]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1426.54epoch/s, loss=1.53e+3, weights_mean=44.1, weights_std=7.94, weights_min=15.1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=431, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=237, loss_rel_change=-0.45]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=150, loss_rel_change=-0.652]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=89.8, loss_rel_change=-0.792]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=55.9, loss_rel_change=-0.87]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=34.6, loss_rel_change=-0.92]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.4, loss_rel_change=-0.948]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.5, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.86, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.38, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.59, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.14, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.49, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.58, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.13, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.944, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.621, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.369, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.337, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.271, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.191, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.143, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.17, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.169, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.18, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.172, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.17, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.158, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.192, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.184, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.195, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.171, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.184, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.18, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.176, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.182, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.191, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.172, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.18, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.202, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.198, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 360.56epoch/s, loss=0.174, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 358.45epoch/s, loss=0.174, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.87e+3, weights_mean=48.7, weights_std=8.46, weights_min=18.6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.83e+3, weights_mean=48.2, weights_std=8.38, weights_min=18.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.79e+3, weights_mean=47.7, weights_std=8.29, weights_min=18.2]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1244.06epoch/s, loss=1.79e+3, weights_mean=47.7, weights_std=8.29, weights_min=18.2]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=525, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=316, loss_rel_change=-0.398]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=186, loss_rel_change=-0.646]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=118, loss_rel_change=-0.774]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=75.8, loss_rel_change=-0.856]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=49.2, loss_rel_change=-0.906]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=30.8, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=20, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.4, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.11, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.66, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.55, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.5, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.33, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.82, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.25, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.863, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.798, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.488, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.32, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.263, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.164, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0984, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0704, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0527, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0364, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0293, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0214, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0126, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0104, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0107, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00992, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0116, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0155, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0135, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0135, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0134, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0151, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0299, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0233, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0197, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0247, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0366, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0204, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0261, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0311, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0284, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0361, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0338, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0328, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0239, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0275, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0395, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0348, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0375, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 365.72epoch/s, loss=0.0345, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 357.55epoch/s, loss=0.0345, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.16e+3, weights_mean=52.3, weights_std=8.74, weights_min=20.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.12e+3, weights_mean=51.8, weights_std=8.66, weights_min=20.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.08e+3, weights_mean=51.3, weights_std=8.57, weights_min=19.9]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1459.51epoch/s, loss=2.08e+3, weights_mean=51.3, weights_std=8.57, weights_min=19.9]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=625, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=369, loss_rel_change=-0.409]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=220, loss_rel_change=-0.647]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=143, loss_rel_change=-0.772]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=89.2, loss_rel_change=-0.857]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=58.3, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=37.1, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=24.5, loss_rel_change=-0.961]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.9, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.4, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.48, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.97, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.26, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.26, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.39, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.71, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.3, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.872, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.673, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.522, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.437, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.309, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.235, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.235, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.107, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0739, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0737, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0437, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0349, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.019, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.014, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0095, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0095, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0134, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0152, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0112, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0144, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0146, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0123, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0158, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0138, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0175, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0158, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0159, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0245, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0241, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0129, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0199, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0226, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0176, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.024, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0224, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.53epoch/s, loss=0.0204, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 363.62epoch/s, loss=0.0204, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.47e+3, weights_mean=55.9, weights_std=8.93, weights_min=26.9]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.42e+3, weights_mean=55.3, weights_std=8.85, weights_min=26.6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.37e+3, weights_mean=54.8, weights_std=8.76, weights_min=26.3]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1274.19epoch/s, loss=2.37e+3, weights_mean=54.8, weights_std=8.76, weights_min=26.3]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=697, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=413, loss_rel_change=-0.407]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=247, loss_rel_change=-0.645]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=153, loss_rel_change=-0.78]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=96.4, loss_rel_change=-0.862]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=62.4, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=44.1, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.9, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.6, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.6, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.1, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.43, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.23, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.1, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.91, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.16, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.79, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.33, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.867, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.698, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.596, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.439, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.377, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.32, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.236, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.226, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.119, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.083, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0644, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0802, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0461, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0584, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0402, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0377, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0377, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0331, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0363, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0381, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0343, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0319, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0354, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.034, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0331, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0305, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0307, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0304, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0308, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0336, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0325, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0309, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0352, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0328, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0354, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0305, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0319, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0337, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0317, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.81epoch/s, loss=0.0325, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 348.33epoch/s, loss=0.0325, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.79e+3, weights_mean=59.2, weights_std=9.14, weights_min=29.7]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.73e+3, weights_mean=58.7, weights_std=9.05, weights_min=29.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.68e+3, weights_mean=58.1, weights_std=8.96, weights_min=29.1]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1433.36epoch/s, loss=2.68e+3, weights_mean=58.1, weights_std=8.96, weights_min=29.1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=810, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=472, loss_rel_change=-0.416]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=290, loss_rel_change=-0.642]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=180, loss_rel_change=-0.777]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=113, loss_rel_change=-0.86]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=74.6, loss_rel_change=-0.908]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=49.5, loss_rel_change=-0.939]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=33.9, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.6, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.4, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.7, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.53, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.36, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.32, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.51, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.5, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.08, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.57, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.35, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.775, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.588, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.518, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.438, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.327, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.247, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.181, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.216, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.169, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.115, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.116, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0834, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0788, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0787, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.078, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0609, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0609, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0496, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0472, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0482, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0524, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0449, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.045, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0488, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0407, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0428, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0339, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0358, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0372, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0327, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.032, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.032, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0302, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0297, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0313, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0314, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0342, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0298, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0311, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 350.45epoch/s, loss=0.0321, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 347.33epoch/s, loss=0.0321, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.11e+3, weights_mean=62.5, weights_std=9.36, weights_min=29.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.05e+3, weights_mean=61.9, weights_std=9.26, weights_min=28.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.99e+3, weights_mean=61.3, weights_std=9.17, weights_min=28.5]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1440.68epoch/s, loss=2.99e+3, weights_mean=61.3, weights_std=9.17, weights_min=28.5]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=946, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=568, loss_rel_change=-0.399]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=362, loss_rel_change=-0.618]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=214, loss_rel_change=-0.774]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=135, loss_rel_change=-0.858]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=87.9, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=60, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=39, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=26.3, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.9, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.1, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.58, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.07, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.51, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.86, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.94, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.52, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.64, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.5, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.1, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.908, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.638, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.547, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.384, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.312, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.286, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.185, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.215, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.168, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0894, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.114, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0867, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0727, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0374, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0374, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0566, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0276, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0242, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0354, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0262, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0225, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0228, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.014, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0118, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0187, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0145, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0145, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0148, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0126, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0124, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.015, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.00744, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.00841, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.0085, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.00967, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.00841, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.00722, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.23epoch/s, loss=0.00741, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 347.04epoch/s, loss=0.00741, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.45e+3, weights_mean=65.7, weights_std=9.55, weights_min=31.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.38e+3, weights_mean=65, weights_std=9.46, weights_min=31]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.31e+3, weights_mean=64.4, weights_std=9.37, weights_min=30.7]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1406.23epoch/s, loss=3.31e+3, weights_mean=64.4, weights_std=9.37, weights_min=30.7]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.08e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=635, loss_rel_change=-0.413]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=379, loss_rel_change=-0.649]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=245, loss_rel_change=-0.773]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=158, loss_rel_change=-0.854]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=99.2, loss_rel_change=-0.908]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=67.2, loss_rel_change=-0.938]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=44.2, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=29.8, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.3, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.3, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.1, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.93, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.33, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.54, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.38, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.76, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.06, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.84, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.933, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.843, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.615, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.634, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.482, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.41, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.319, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.283, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.28, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.209, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0819, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.102, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0948, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.127, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0885, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0885, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0425, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0441, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0462, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.047, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0417, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0253, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0385, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0296, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0225, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.022, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0342, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0186, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0206, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0185, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0172, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0186, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0174, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0159, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0195, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0106, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0088, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0175, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 351.66epoch/s, loss=0.0188, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 348.34epoch/s, loss=0.0188, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.79e+3, weights_mean=68.9, weights_std=9.72, weights_min=36.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.71e+3, weights_mean=68.2, weights_std=9.62, weights_min=36]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.64e+3, weights_mean=67.5, weights_std=9.52, weights_min=35.6]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1429.88epoch/s, loss=3.64e+3, weights_mean=67.5, weights_std=9.52, weights_min=35.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.41e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.49e+3, loss_rel_change=-0.382]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=981, loss_rel_change=-0.592]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=633, loss_rel_change=-0.737]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=431, loss_rel_change=-0.821]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=301, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=206, loss_rel_change=-0.915]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=149, loss_rel_change=-0.938]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=113, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=80.7, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=57.6, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=45.1, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=36.8, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.9, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.9, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=12.2, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.2, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.87, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.96, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.31, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.43, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.69, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.94, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.64, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.13, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.82, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.75, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.45, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.12, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.98, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.83, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.46, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.39, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.23, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.15, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.12, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.01, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.909, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.875, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.824, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.819, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.874, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.727, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.746, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.838, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.785, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.748, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.661, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.784, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.756, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.761, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.62epoch/s, loss=0.686, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 349.74epoch/s, loss=0.686, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.13e+3, weights_mean=71.9, weights_std=9.87, weights_min=36.6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.05e+3, weights_mean=71.2, weights_std=9.78, weights_min=36.2]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.97e+3, weights_mean=70.5, weights_std=9.68, weights_min=35.9]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1449.61epoch/s, loss=3.97e+3, weights_mean=70.5, weights_std=9.68, weights_min=35.9]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.59e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.65e+3, loss_rel_change=-0.362]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.08e+3, loss_rel_change=-0.583]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=706, loss_rel_change=-0.727]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=476, loss_rel_change=-0.816]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=324, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=231, loss_rel_change=-0.911]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=164, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=115, loss_rel_change=-0.955]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=86.2, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=64.9, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=49.7, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=40.5, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=30, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=25, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.2, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.7, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.5, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.95, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.26, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.07, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.95, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.35, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.61, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.13, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.62, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.32, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.04, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.82, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.18, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.45, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.06, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.15, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.88, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.88, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.71, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.56, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.51, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.34, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.18, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.31, loss_rel_change=-0.999]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.27, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.11, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1.06, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.986, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.934, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.934, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=1, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.851, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.985, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.869, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.852, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.777, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.835, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.808, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 347.20epoch/s, loss=0.806, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 345.05epoch/s, loss=0.806, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.49e+3, weights_mean=74.8, weights_std=9.98, weights_min=40.7]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.4e+3, weights_mean=74.1, weights_std=9.88, weights_min=40.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.31e+3, weights_mean=73.4, weights_std=9.78, weights_min=39.9]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1442.91epoch/s, loss=4.31e+3, weights_mean=73.4, weights_std=9.78, weights_min=39.9]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.32e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43e+3, loss_rel_change=-0.383]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=935, loss_rel_change=-0.597]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=612, loss_rel_change=-0.736]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=390, loss_rel_change=-0.832]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=270, loss_rel_change=-0.884]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=188, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=133, loss_rel_change=-0.942]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=88.5, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=68.5, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=48.9, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=36.5, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.5, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.3, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=12.9, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.1, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.55, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.47, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.45, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.79, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.19, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.84, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.97, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.36, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.28, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.57, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.57, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.24, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.05, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.26, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.943, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.842, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.85, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.85, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.825, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.666, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.711, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.673, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.555, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.663, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.501, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.55, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.52, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.501, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.495, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.495, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.456, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.482, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.431, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.439, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.485, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.475, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.461, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.444, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.491, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.461, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 362.50epoch/s, loss=0.37, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 359.80epoch/s, loss=0.37, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.85e+3, weights_mean=77.8, weights_std=10, weights_min=42.2]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.76e+3, weights_mean=77, weights_std=9.94, weights_min=41.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.66e+3, weights_mean=76.3, weights_std=9.85, weights_min=41.4]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1441.49epoch/s, loss=4.66e+3, weights_mean=76.3, weights_std=9.85, weights_min=41.4]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.53e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.6e+3, loss_rel_change=-0.369]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=984, loss_rel_change=-0.612]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=642, loss_rel_change=-0.747]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=429, loss_rel_change=-0.831]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=294, loss_rel_change=-0.884]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=206, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=142, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=102, loss_rel_change=-0.96]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=75.9, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=53.4, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=41.3, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=31, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=23.4, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.47, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.84, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.39, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.57, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.2, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.21, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.89, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.28, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.24, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.6, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.27, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.81, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.76, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.64, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.45, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.39, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.4, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=1.16, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.975, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.974, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.961, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.793, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.82, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.734, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.742, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.716, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.649, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.843, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.623, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.723, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.626, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.58, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.552, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.541, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.587, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.555, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.536, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.447, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.545, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.486, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.475, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.89epoch/s, loss=0.565, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 354.57epoch/s, loss=0.565, loss_rel_change=-1]
Data leakage warning: Targets often share overlapping information (e.g., geographic breakdowns like 'snap in CA' and 'snap in US'). Holdout validation may not provide complete isolation between training and validation sets. The robustness metrics should be interpreted with this limitation in mind - they may overestimate the model's true generalization performance.
Tuning with Balanced objectives...
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=20.6, weights_mean=6.06, weights_std=2.9, weights_min=1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=20.1, weights_mean=6, weights_std=2.87, weights_min=0.992]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=19.6, weights_mean=5.94, weights_std=2.84, weights_min=0.982]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1369.57epoch/s, loss=19.6, weights_mean=5.94, weights_std=2.84, weights_min=0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0542, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0288, loss_rel_change=-0.468]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.047, loss_rel_change=-0.132]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0346, loss_rel_change=-0.362]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0331, loss_rel_change=-0.39]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0367, loss_rel_change=-0.324]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.034, loss_rel_change=-0.372]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0299, loss_rel_change=-0.448]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0329, loss_rel_change=-0.393]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0314, loss_rel_change=-0.42]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.475]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0297, loss_rel_change=-0.453]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0309, loss_rel_change=-0.43]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.03, loss_rel_change=-0.447]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.029, loss_rel_change=-0.464]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0293, loss_rel_change=-0.459]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.028, loss_rel_change=-0.483]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.471]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.455]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0296, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0287, loss_rel_change=-0.47]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0298, loss_rel_change=-0.45]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0285, loss_rel_change=-0.474]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0284, loss_rel_change=-0.477]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0283, loss_rel_change=-0.479]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.481]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0284, loss_rel_change=-0.476]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0285, loss_rel_change=-0.475]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0283, loss_rel_change=-0.478]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.48]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0286, loss_rel_change=-0.473]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.481]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0281, loss_rel_change=-0.482]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 339.31epoch/s, loss=0.0282, loss_rel_change=-0.479]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 344.54epoch/s, loss=0.0282, loss_rel_change=-0.479]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=80, weights_mean=10.9, weights_std=4.04, weights_min=1.16]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=78.2, weights_mean=10.8, weights_std=4, weights_min=1.15]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=76.5, weights_mean=10.7, weights_std=3.96, weights_min=1.13]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1463.06epoch/s, loss=76.5, weights_mean=10.7, weights_std=3.96, weights_min=1.13]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.4, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.87, loss_rel_change=-0.426]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.22, loss_rel_change=-0.662]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.96, loss_rel_change=-0.809]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.65, loss_rel_change=-0.893]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.884, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.469, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.215, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.101, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0471, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0292, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0318, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0451, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0669, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0861, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.111, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.133, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.155, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.172, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.191, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.202, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.216, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.231, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.245, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.25, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.256, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.264, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.266, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.276, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.274, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.278, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.27, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.271, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.272, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.268, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.266, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.266, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.262, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.257, loss_rel_change=-0.983]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.251, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.254, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.245, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.242, loss_rel_change=-0.984]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.233, loss_rel_change=-0.985]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.228, loss_rel_change=-0.985]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.218, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.212, loss_rel_change=-0.986]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.207, loss_rel_change=-0.987]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.205, loss_rel_change=-0.987]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.197, loss_rel_change=-0.987]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.193, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.181, loss_rel_change=-0.988]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.173, loss_rel_change=-0.989]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.166, loss_rel_change=-0.989]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.153, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.155, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.149, loss_rel_change=-0.99]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.136, loss_rel_change=-0.991]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.131, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.123, loss_rel_change=-0.992]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 359.13epoch/s, loss=0.114, loss_rel_change=-0.993]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 352.41epoch/s, loss=0.114, loss_rel_change=-0.993]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=172, weights_mean=15.6, weights_std=4.86, weights_min=1.77]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=169, weights_mean=15.4, weights_std=4.81, weights_min=1.75]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=165, weights_mean=15.3, weights_std=4.77, weights_min=1.73]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1419.10epoch/s, loss=165, weights_mean=15.3, weights_std=4.77, weights_min=1.73]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.5, loss_rel_change=-0.454]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.65, loss_rel_change=-0.706]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.02, loss_rel_change=-0.843]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.48, loss_rel_change=-0.923]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.695, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.276, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.064, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0585, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0799, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0939, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.146, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.184, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.22, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.236, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.296, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.319, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.333, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.343, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.362, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.375, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.391, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.412, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.404, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.417, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.441, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.408, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.391, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.413, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.409, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.363, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.378, loss_rel_change=-0.98]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.378, loss_rel_change=-0.98]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.369, loss_rel_change=-0.981]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.347, loss_rel_change=-0.982]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.32, loss_rel_change=-0.983]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.339, loss_rel_change=-0.982]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.276, loss_rel_change=-0.986]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.282, loss_rel_change=-0.985]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.23, loss_rel_change=-0.988]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.219, loss_rel_change=-0.989]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.19, loss_rel_change=-0.99]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.15, loss_rel_change=-0.992]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.18, loss_rel_change=-0.991]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.141, loss_rel_change=-0.993]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0951, loss_rel_change=-0.995]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0914, loss_rel_change=-0.995]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.102, loss_rel_change=-0.995]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0972, loss_rel_change=-0.995]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.102, loss_rel_change=-0.995]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0699, loss_rel_change=-0.996]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0744, loss_rel_change=-0.996]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0648, loss_rel_change=-0.997]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0675, loss_rel_change=-0.996]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0619, loss_rel_change=-0.997]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0801, loss_rel_change=-0.996]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.07, loss_rel_change=-0.996]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0569, loss_rel_change=-0.997]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 332.74epoch/s, loss=0.0703, loss_rel_change=-0.996]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 340.99epoch/s, loss=0.0703, loss_rel_change=-0.996]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=299, weights_mean=20.2, weights_std=5.48, weights_min=3.63]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=293, weights_mean=20, weights_std=5.43, weights_min=3.59]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=287, weights_mean=19.8, weights_std=5.37, weights_min=3.56]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1294.58epoch/s, loss=287, weights_mean=19.8, weights_std=5.37, weights_min=3.56]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=43.2, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=26.1, loss_rel_change=-0.396]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.3, loss_rel_change=-0.67]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.74, loss_rel_change=-0.821]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.48, loss_rel_change=-0.896]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.38, loss_rel_change=-0.945]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.25, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.708, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.328, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.177, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0713, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0561, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0572, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0724, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.101, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.12, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.153, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.199, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.217, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.254, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.256, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.309, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.309, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.303, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.312, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.325, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.33, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.362, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.364, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.359, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.36, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.377, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.375, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.366, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.366, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.364, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.373, loss_rel_change=-0.991]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.358, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.388, loss_rel_change=-0.991]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.364, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.391, loss_rel_change=-0.991]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.404, loss_rel_change=-0.991]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.359, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.359, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.354, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.341, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.355, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.346, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.333, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.334, loss_rel_change=-0.992]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.291, loss_rel_change=-0.993]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.287, loss_rel_change=-0.993]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.273, loss_rel_change=-0.994]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.258, loss_rel_change=-0.994]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.232, loss_rel_change=-0.995]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.225, loss_rel_change=-0.995]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.28, loss_rel_change=-0.994]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.196, loss_rel_change=-0.995]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.229, loss_rel_change=-0.995]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 343.48epoch/s, loss=0.182, loss_rel_change=-0.996]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 348.57epoch/s, loss=0.182, loss_rel_change=-0.996]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=451, weights_mean=24.5, weights_std=6.07, weights_min=6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=442, weights_mean=24.3, weights_std=6.01, weights_min=5.94]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=433, weights_mean=24.1, weights_std=5.95, weights_min=5.88]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1439.96epoch/s, loss=433, weights_mean=24.1, weights_std=5.95, weights_min=5.88]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=204, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=126, loss_rel_change=-0.381]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=81.5, loss_rel_change=-0.599]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=51.9, loss_rel_change=-0.745]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=32.6, loss_rel_change=-0.84]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.3, loss_rel_change=-0.895]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.7, loss_rel_change=-0.928]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.1, loss_rel_change=-0.95]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.66, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.59, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.08, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.3, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.59, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.16, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.797, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.573, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.411, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.273, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.18, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0783, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0512, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0407, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0214, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0167, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00807, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00698, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00663, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00807, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0137, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0153, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0199, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0244, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0238, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.028, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0284, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0284, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0404, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.041, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0382, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0425, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0427, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0475, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0516, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0448, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0484, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0549, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0541, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0623, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0566, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0578, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0513, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0576, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.056, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0565, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0591, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0627, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0606, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.061, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.23epoch/s, loss=0.0603, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 363.92epoch/s, loss=0.0603, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=636, weights_mean=28.9, weights_std=6.58, weights_min=8.69]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=623, weights_mean=28.6, weights_std=6.51, weights_min=8.6]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=610, weights_mean=28.3, weights_std=6.45, weights_min=8.51]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1417.95epoch/s, loss=610, weights_mean=28.3, weights_std=6.45, weights_min=8.51]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=313, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=193, loss_rel_change=-0.382]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=125, loss_rel_change=-0.601]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=79.8, loss_rel_change=-0.745]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=52.2, loss_rel_change=-0.833]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=34.1, loss_rel_change=-0.891]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.9, loss_rel_change=-0.927]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16, loss_rel_change=-0.949]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.5, loss_rel_change=-0.963]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.87, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.75, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.19, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.93, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.2, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.72, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.21, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.912, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.642, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.523, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.395, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.286, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.224, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.162, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.117, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0914, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0662, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0549, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0426, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0205, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.015, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0139, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00913, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00715, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00707, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00652, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.00646, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.00646, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.00724, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.00773, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.00883, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.00923, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.00919, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.00963, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0126, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0119, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0147, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0165, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0163, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0151, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0171, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.021, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0196, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.019, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0185, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.019, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0187, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.019, loss_rel_change=-1]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 368.48epoch/s, loss=0.0218, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 364.58epoch/s, loss=0.0218, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=838, weights_mean=33, weights_std=6.92, weights_min=11]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=821, weights_mean=32.7, weights_std=6.85, weights_min=10.9]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=804, weights_mean=32.4, weights_std=6.78, weights_min=10.8]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1478.24epoch/s, loss=804, weights_mean=32.4, weights_std=6.78, weights_min=10.8]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=138, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=81.1, loss_rel_change=-0.413]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=47.4, loss_rel_change=-0.657]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.4, loss_rel_change=-0.794]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.7, loss_rel_change=-0.879]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10.4, loss_rel_change=-0.925]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.27, loss_rel_change=-0.955]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.5, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.69, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.72, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.14, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.725, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.486, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.318, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.238, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.142, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.131, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.156, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.173, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.18, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.197, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.2, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.219, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.223, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.232, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.233, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.232, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.247, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.258, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.243, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.263, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.263, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.254, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.267, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.273, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.272, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.29, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.267, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.282, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.272, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.268, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.278, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.289, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.282, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.289, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.279, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.296, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.292, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.282, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.284, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.284, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.277, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.27, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.278, loss_rel_change=-0.998]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.07epoch/s, loss=0.271, loss_rel_change=-0.998]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 362.14epoch/s, loss=0.271, loss_rel_change=-0.998]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.06e+3, weights_mean=37, weights_std=7.26, weights_min=11.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.04e+3, weights_mean=36.6, weights_std=7.19, weights_min=11.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.02e+3, weights_mean=36.3, weights_std=7.12, weights_min=11.2]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1444.00epoch/s, loss=1.02e+3, weights_mean=36.3, weights_std=7.12, weights_min=11.2]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=180, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=110, loss_rel_change=-0.388]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=63.9, loss_rel_change=-0.646]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=39.4, loss_rel_change=-0.781]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=23.2, loss_rel_change=-0.871]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.5, loss_rel_change=-0.914]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.06, loss_rel_change=-0.95]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.05, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.87, loss_rel_change=-0.978]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.58, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.68, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.14, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.801, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.541, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.4, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.299, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.205, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.168, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.126, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.122, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.123, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.13, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.139, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.143, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.165, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.179, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.184, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.199, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.195, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.201, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.214, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.205, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.205, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.229, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.219, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.225, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.234, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.243, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.247, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.249, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.249, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.243, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.247, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.244, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.256, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.248, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.255, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.25, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.248, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.249, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.251, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.263, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.242, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.248, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 367.26epoch/s, loss=0.254, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 361.98epoch/s, loss=0.254, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.31e+3, weights_mean=41, weights_std=7.69, weights_min=12.5]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.28e+3, weights_mean=40.6, weights_std=7.62, weights_min=12.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.26e+3, weights_mean=40.2, weights_std=7.54, weights_min=12.2]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1494.35epoch/s, loss=1.26e+3, weights_mean=40.2, weights_std=7.54, weights_min=12.2]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=328, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=188, loss_rel_change=-0.428]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=121, loss_rel_change=-0.633]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=69.8, loss_rel_change=-0.787]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=46.4, loss_rel_change=-0.859]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=25.8, loss_rel_change=-0.921]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.3, loss_rel_change=-0.947]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.3, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.68, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.79, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.45, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.24, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.73, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.15, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.789, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.55, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.388, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.327, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.217, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.208, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.168, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.146, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.133, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.135, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.145, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.175, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.196, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.17, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.163, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.204, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.203, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.198, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.181, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.202, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.189, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.233, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.216, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.214, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.232, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.219, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.229, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.208, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.208, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.228, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.227, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.215, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.226, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.214, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.242, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.247, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.239, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.226, loss_rel_change=-0.999]
Sparse reweighting progress: 62%|██████▏ | 37/60 [00:00<00:00, 364.77epoch/s, loss=0.232, loss_rel_change=-0.999]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 359.95epoch/s, loss=0.232, loss_rel_change=-0.999]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.58e+3, weights_mean=44.8, weights_std=8.06, weights_min=17.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.55e+3, weights_mean=44.3, weights_std=7.98, weights_min=17.2]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.52e+3, weights_mean=43.9, weights_std=7.9, weights_min=17.1]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1429.76epoch/s, loss=1.52e+3, weights_mean=43.9, weights_std=7.9, weights_min=17.1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=435, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=234, loss_rel_change=-0.462]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=149, loss_rel_change=-0.658]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=89.4, loss_rel_change=-0.794]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=55.9, loss_rel_change=-0.871]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=34.1, loss_rel_change=-0.922]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.7, loss_rel_change=-0.948]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.5, loss_rel_change=-0.964]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10, loss_rel_change=-0.977]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.39, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.59, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.08, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.37, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.58, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.13, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.932, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.61, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.356, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.347, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.259, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.203, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.197, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.159, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.142, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.134, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.125, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.128, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.136, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.129, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.141, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.139, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.148, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.165, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.137, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.173, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.175, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.185, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.171, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.169, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.192, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.185, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.183, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.198, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.167, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.17, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.183, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.179, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.186, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.173, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.181, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.201, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.191, loss_rel_change=-1]
Sparse reweighting progress: 57%|█████▋ | 34/60 [00:00<00:00, 338.07epoch/s, loss=0.177, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 327.66epoch/s, loss=0.177, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.85e+3, weights_mean=48.5, weights_std=8.4, weights_min=18.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.81e+3, weights_mean=48, weights_std=8.32, weights_min=18.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=1.78e+3, weights_mean=47.5, weights_std=8.24, weights_min=17.9]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1284.01epoch/s, loss=1.78e+3, weights_mean=47.5, weights_std=8.24, weights_min=17.9]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=520, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=310, loss_rel_change=-0.403]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=186, loss_rel_change=-0.642]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=118, loss_rel_change=-0.773]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=75.2, loss_rel_change=-0.855]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=48.4, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=30, loss_rel_change=-0.942]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.8, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.91, loss_rel_change=-0.983]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.52, loss_rel_change=-0.987]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.41, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.42, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.28, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.74, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.22, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.822, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.771, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.463, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.318, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.263, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.183, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.157, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0913, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0687, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.054, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0367, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0269, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.02, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0161, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0124, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.01, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0115, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0101, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.012, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0156, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0156, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0131, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0109, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0137, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0164, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0311, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0251, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0201, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0284, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0386, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0203, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0286, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0335, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0335, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0296, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0377, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0347, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0343, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0241, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0294, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0318, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0428, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0379, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0394, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 355.88epoch/s, loss=0.0344, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 343.30epoch/s, loss=0.0344, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.14e+3, weights_mean=52.1, weights_std=8.68, weights_min=18]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.1e+3, weights_mean=51.6, weights_std=8.59, weights_min=17.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.06e+3, weights_mean=51, weights_std=8.5, weights_min=17.7]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1312.43epoch/s, loss=2.06e+3, weights_mean=51, weights_std=8.5, weights_min=17.7]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=623, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=367, loss_rel_change=-0.411]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=218, loss_rel_change=-0.649]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=142, loss_rel_change=-0.771]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=88.6, loss_rel_change=-0.858]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=57.8, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=36.5, loss_rel_change=-0.941]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=24.1, loss_rel_change=-0.961]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17, loss_rel_change=-0.973]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.4, loss_rel_change=-0.982]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.52, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.94, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.18, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.27, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.34, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.68, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.27, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.871, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.655, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.532, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.423, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.31, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.23, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.234, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.12, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.111, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0746, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0702, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0426, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0353, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0308, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0133, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.011, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0105, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.00954, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0104, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0103, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0144, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0158, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0117, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0151, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0142, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0122, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0172, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0134, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0174, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.018, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0166, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0169, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0255, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0249, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0128, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0203, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0225, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0173, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0248, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0247, loss_rel_change=-1]
Sparse reweighting progress: 53%|█████▎ | 32/60 [00:00<00:00, 317.91epoch/s, loss=0.0214, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 329.33epoch/s, loss=0.0214, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.45e+3, weights_mean=55.6, weights_std=8.97, weights_min=23]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.4e+3, weights_mean=55.1, weights_std=8.88, weights_min=22.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.35e+3, weights_mean=54.5, weights_std=8.79, weights_min=22.6]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1409.47epoch/s, loss=2.35e+3, weights_mean=54.5, weights_std=8.79, weights_min=22.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=683, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=408, loss_rel_change=-0.402]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=245, loss_rel_change=-0.64]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=152, loss_rel_change=-0.777]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=94.8, loss_rel_change=-0.861]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=61.5, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=43.9, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.5, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=19.3, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.4, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.22, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.09, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.98, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.82, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.1, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.78, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.3, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.829, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.668, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.575, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.407, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.36, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.315, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.217, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.206, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.151, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.111, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.112, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0755, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0598, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0751, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0448, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0565, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0389, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0367, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0367, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0323, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0347, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0368, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0329, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0331, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0332, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0323, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0305, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.031, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.033, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0327, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0313, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0354, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0341, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0352, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0309, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.032, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0342, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0333, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 354.68epoch/s, loss=0.0335, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 351.67epoch/s, loss=0.0335, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.77e+3, weights_mean=59, weights_std=9.2, weights_min=23.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.71e+3, weights_mean=58.4, weights_std=9.11, weights_min=22.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.66e+3, weights_mean=57.8, weights_std=9.01, weights_min=22.6]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1435.41epoch/s, loss=2.66e+3, weights_mean=57.8, weights_std=9.01, weights_min=22.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=798, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=465, loss_rel_change=-0.417]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=289, loss_rel_change=-0.638]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=178, loss_rel_change=-0.778]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=113, loss_rel_change=-0.858]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=74.1, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=49.3, loss_rel_change=-0.938]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=33.6, loss_rel_change=-0.958]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=22.2, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.1, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.7, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.54, loss_rel_change=-0.989]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.3, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.28, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.46, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.49, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.07, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.51, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.34, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.767, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.57, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.49, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.423, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.322, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.235, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.176, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.206, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.161, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.114, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.116, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.08, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0762, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0737, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0743, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0583, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0583, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0463, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0445, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0453, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0507, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0429, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0445, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0459, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0424, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0411, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0335, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0359, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0366, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0323, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0316, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0315, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0301, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0296, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0312, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0313, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0324, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0298, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0314, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 353.50epoch/s, loss=0.0317, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 350.41epoch/s, loss=0.0317, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.08e+3, weights_mean=62.3, weights_std=9.38, weights_min=27.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.02e+3, weights_mean=61.7, weights_std=9.28, weights_min=26.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=2.96e+3, weights_mean=61.1, weights_std=9.19, weights_min=26.6]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1431.21epoch/s, loss=2.96e+3, weights_mean=61.1, weights_std=9.19, weights_min=26.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=940, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=563, loss_rel_change=-0.401]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=356, loss_rel_change=-0.621]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=212, loss_rel_change=-0.775]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=133, loss_rel_change=-0.859]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=87.2, loss_rel_change=-0.907]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=60.3, loss_rel_change=-0.936]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=38.8, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=26, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.8, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.55, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.1, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.51, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.84, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.84, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.39, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.65, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.47, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.07, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.9, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.628, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.536, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.381, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.296, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.272, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.173, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.219, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.173, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.14, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.088, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.12, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.081, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0735, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0384, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0548, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0548, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0285, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0261, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0331, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0257, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.023, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0209, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0154, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0127, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0164, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0143, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0134, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0179, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0132, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0124, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0134, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.0152, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00961, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00789, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00832, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00844, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00935, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00911, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00796, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 348.99epoch/s, loss=0.00758, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 332.98epoch/s, loss=0.00758, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.42e+3, weights_mean=65.5, weights_std=9.52, weights_min=33.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.35e+3, weights_mean=64.8, weights_std=9.43, weights_min=33.5]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.28e+3, weights_mean=64.2, weights_std=9.33, weights_min=33.2]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1307.10epoch/s, loss=3.28e+3, weights_mean=64.2, weights_std=9.33, weights_min=33.2]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.08e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=626, loss_rel_change=-0.418]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=377, loss_rel_change=-0.649]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=242, loss_rel_change=-0.775]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=156, loss_rel_change=-0.855]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=99.3, loss_rel_change=-0.908]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=66.2, loss_rel_change=-0.938]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=43.9, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=29.9, loss_rel_change=-0.972]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.6, loss_rel_change=-0.98]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.3, loss_rel_change=-0.986]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.94, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.18, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.54, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.4, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.72, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.01, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.82, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.912, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.862, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.594, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.626, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.457, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.403, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.297, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.284, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.26, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.204, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.121, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0817, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.11, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.0892, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.132, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0888, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.043, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0412, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0446, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.041, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0422, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0216, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0385, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0329, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0233, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0211, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0306, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0183, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0191, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0174, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.017, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.016, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0165, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0164, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0169, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0185, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0114, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.00946, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0166, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 348.90epoch/s, loss=0.0161, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 347.18epoch/s, loss=0.0161, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.75e+3, weights_mean=68.6, weights_std=9.66, weights_min=36.2]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.67e+3, weights_mean=67.9, weights_std=9.57, weights_min=35.9]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.6e+3, weights_mean=67.2, weights_std=9.47, weights_min=35.5]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1429.70epoch/s, loss=3.6e+3, weights_mean=67.2, weights_std=9.47, weights_min=35.5]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.38e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.47e+3, loss_rel_change=-0.382]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=971, loss_rel_change=-0.593]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=629, loss_rel_change=-0.736]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=426, loss_rel_change=-0.822]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=298, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=204, loss_rel_change=-0.915]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=148, loss_rel_change=-0.938]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=111, loss_rel_change=-0.953]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=79.9, loss_rel_change=-0.966]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=56.8, loss_rel_change=-0.976]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=45, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=36.5, loss_rel_change=-0.985]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.7, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.7, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=17.8, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=14.8, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=12, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.85, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.96, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.2, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.37, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.56, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.95, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.67, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.1, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.82, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.67, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.42, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.28, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.09, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.96, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.79, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.67, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.44, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.39, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.2, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.14, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.1, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.991, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.982, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.882, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.872, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=1.02, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.809, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.781, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.849, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.71, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.75, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.826, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.782, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.746, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.628, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.758, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.742, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.771, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 352.01epoch/s, loss=0.668, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 348.58epoch/s, loss=0.668, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.1e+3, weights_mean=71.6, weights_std=9.82, weights_min=35.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.02e+3, weights_mean=70.9, weights_std=9.72, weights_min=34.9]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=3.94e+3, weights_mean=70.2, weights_std=9.63, weights_min=34.6]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1347.87epoch/s, loss=3.94e+3, weights_mean=70.2, weights_std=9.63, weights_min=34.6]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.56e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.63e+3, loss_rel_change=-0.361]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.07e+3, loss_rel_change=-0.581]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=700, loss_rel_change=-0.726]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=473, loss_rel_change=-0.815]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=320, loss_rel_change=-0.875]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=230, loss_rel_change=-0.91]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=161, loss_rel_change=-0.937]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=114, loss_rel_change=-0.955]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=85.3, loss_rel_change=-0.967]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=64.4, loss_rel_change=-0.975]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=49.6, loss_rel_change=-0.981]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=40.1, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=29.9, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=24.6, loss_rel_change=-0.99]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=18.9, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.6, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.5, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=11.4, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.73, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.11, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.96, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.86, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.23, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.56, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.09, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.5, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.26, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.75, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.14, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.43, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.06, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.1, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.84, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.69, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.72, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.51, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.51, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.33, loss_rel_change=-0.999]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.17, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.24, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.25, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.09, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.03, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.966, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.939, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.896, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.992, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.84, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.97, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.836, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.836, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.777, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.799, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.797, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.90epoch/s, loss=0.782, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 354.81epoch/s, loss=0.782, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.45e+3, weights_mean=74.6, weights_std=9.98, weights_min=37.4]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.36e+3, weights_mean=73.9, weights_std=9.88, weights_min=37.1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.27e+3, weights_mean=73.1, weights_std=9.79, weights_min=36.7]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1379.42epoch/s, loss=4.27e+3, weights_mean=73.1, weights_std=9.79, weights_min=36.7]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.31e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43e+3, loss_rel_change=-0.382]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=931, loss_rel_change=-0.597]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=611, loss_rel_change=-0.736]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=386, loss_rel_change=-0.833]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=267, loss_rel_change=-0.885]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=185, loss_rel_change=-0.92]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=131, loss_rel_change=-0.943]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=87.7, loss_rel_change=-0.962]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=67.3, loss_rel_change=-0.971]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=47.9, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=35.9, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=28.4, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=21.9, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=16.9, loss_rel_change=-0.993]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=12.7, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=10, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.43, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.41, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=6.35, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.67, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.26, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.77, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.95, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.72, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.34, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.33, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.73, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.65, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.56, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.54, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.21, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.04, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.21, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1, loss_rel_change=-1]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=0.862, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.862, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.845, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.836, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.647, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.705, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.673, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.535, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.667, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.507, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.543, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.503, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.508, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.489, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.495, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.456, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.468, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.421, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.443, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.473, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.458, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.453, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.438, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.484, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.455, loss_rel_change=-1]
Sparse reweighting progress: 60%|██████ | 36/60 [00:00<00:00, 356.88epoch/s, loss=0.361, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 351.32epoch/s, loss=0.361, loss_rel_change=-1]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.81e+3, weights_mean=77.5, weights_std=10.1, weights_min=45.8]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.72e+3, weights_mean=76.8, weights_std=9.97, weights_min=45.3]
Reweighting progress: 0%| | 0/30 [00:00<?, ?epoch/s, loss=4.62e+3, weights_mean=76, weights_std=9.87, weights_min=44.9]
Reweighting progress: 100%|██████████| 30/30 [00:00<00:00, 1438.29epoch/s, loss=4.62e+3, weights_mean=76, weights_std=9.87, weights_min=44.9]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.51e+3, loss_rel_change=0]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.59e+3, loss_rel_change=-0.368]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=980, loss_rel_change=-0.61]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=634, loss_rel_change=-0.748]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=424, loss_rel_change=-0.831]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=292, loss_rel_change=-0.884]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=202, loss_rel_change=-0.919]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=140, loss_rel_change=-0.944]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=103, loss_rel_change=-0.959]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=75.7, loss_rel_change=-0.97]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=52.1, loss_rel_change=-0.979]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=40.7, loss_rel_change=-0.984]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=30.9, loss_rel_change=-0.988]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=23.1, loss_rel_change=-0.991]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=18.9, loss_rel_change=-0.992]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=15.4, loss_rel_change=-0.994]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=13.4, loss_rel_change=-0.995]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=9.2, loss_rel_change=-0.996]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=8.73, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=7.32, loss_rel_change=-0.997]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.61, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=5.17, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=4.14, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.83, loss_rel_change=-0.998]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.28, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=3.14, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.59, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=2.24, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.8, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.74, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.63, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.43, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.37, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.37, loss_rel_change=-0.999]
Sparse reweighting progress: 0%| | 0/60 [00:00<?, ?epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=1.13, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=1.17, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.95, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.985, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.977, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.772, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.791, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.708, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.715, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.695, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.637, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.808, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.625, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.735, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.614, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.541, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.553, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.547, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.595, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.568, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.528, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.425, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.537, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.483, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.472, loss_rel_change=-1]
Sparse reweighting progress: 58%|█████▊ | 35/60 [00:00<00:00, 349.78epoch/s, loss=0.554, loss_rel_change=-1]
Sparse reweighting progress: 100%|██████████| 60/60 [00:00<00:00, 344.29epoch/s, loss=0.554, loss_rel_change=-1]
==================================================
Objective balance comparison:
Config l0_lambda Accuracy Sparsity
Accuracy-focused 1.31e-06 50.0% 0.0%
Sparsity-focused 1.58e-05 50.0% 1.6%
Balanced 1.58e-05 50.0% 1.5%
Best practices for hyperparameter tuning¶
1. Start with fewer trials¶
Begin with 10-20 trials to get a sense of the parameter space, then increase if needed.
2. Adjust objective balance based on your needs¶
High accuracy weight: When precision is critical
High sparsity weight: When dataset reduction is the priority
Balanced: Good starting point for most use cases
3. Use appropriate cross-validation¶
More holdout sets: Better generalization estimates but slower
Larger holdout fraction: More robust validation but less training data
4. Consider computational resources¶
Reduce
epochs_per_trialfor faster explorationUse
n_jobs=-1for parallel trials if you have multiple cores
5. Monitor for overfitting¶
Watch for large gaps between training and validation performance.
6. Data leakage awareness¶
Remember that targets often share information (e.g., ‘income_north’ and ‘total_income’), so validation metrics may be optimistic.
Next steps¶
After finding optimal hyperparameters:
Apply them to your full calibration with more epochs
Evaluate robustness using the Robustness evaluation notebook
Save the parameters for future use
Consider fine-tuning if results aren’t satisfactory
The tuned parameters are specific to your dataset and target configuration, so re-tune if these change significantly.